-- Logs begin at Thu 2022-09-08 18:02:10 UTC, end at Thu 2022-09-08 18:56:34 UTC. -- Sep 08 18:27:43.549012 dv-cinder-856463-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 18:27:43.557692 dv-cinder-856463-3-smb devstack@keystone.service[81712]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 18:27:43 2022] *** Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: nodename: dv-cinder-856463-3-smb Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: machine: x86_64 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: clock source: unix Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: pcre jit disabled Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: detected number of CPU cores: 4 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: current working directory: / Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: detected binary path: /usr/bin/uwsgi-core Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: your processes number limit is 47680 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: your memory page size is 4096 bytes Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: detected max file descriptor number: 2048 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: lock engine: pthread robust mutexes Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: thunder lock: enabled Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 18:27:43.564853 dv-cinder-856463-3-smb devstack@keystone.service[81712]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 18:27:43.599390 dv-cinder-856463-3-smb devstack@keystone.service[81712]: Python main interpreter initialized at 0x563f6a06a9c0 Sep 08 18:27:43.599390 dv-cinder-856463-3-smb devstack@keystone.service[81712]: python threads support enabled Sep 08 18:27:43.599390 dv-cinder-856463-3-smb devstack@keystone.service[81712]: your server socket listen backlog is limited to 100 connections Sep 08 18:27:43.599390 dv-cinder-856463-3-smb devstack@keystone.service[81712]: your mercy for graceful operations on workers is 90 seconds Sep 08 18:27:43.599758 dv-cinder-856463-3-smb devstack@keystone.service[81712]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 18:27:43.599849 dv-cinder-856463-3-smb devstack@keystone.service[81712]: *** Operational MODE: preforking *** Sep 08 18:27:43.600083 dv-cinder-856463-3-smb devstack@keystone.service[81712]: *** uWSGI is running in multiple interpreter mode *** Sep 08 18:27:43.600083 dv-cinder-856463-3-smb devstack@keystone.service[81712]: spawned uWSGI master process (pid: 81712) Sep 08 18:27:43.600278 dv-cinder-856463-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 18:27:43.605970 dv-cinder-856463-3-smb devstack@keystone.service[81712]: spawned uWSGI worker 1 (pid: 81720, cores: 1) Sep 08 18:27:43.605970 dv-cinder-856463-3-smb devstack@keystone.service[81712]: spawned uWSGI worker 2 (pid: 81721, cores: 1) Sep 08 18:27:43.605970 dv-cinder-856463-3-smb devstack@keystone.service[81712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 18:27:47.862425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 18:27:47.862425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Sep 08 18:27:47.863208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 18:27:47.863208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: from cryptography.utils import int_from_bytes Sep 08 18:27:47.863621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 18:27:47.863621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Sep 08 18:27:47.863736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 18:27:47.863736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: from cryptography.utils import int_from_bytes Sep 08 18:27:47.912081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 18:27:47.912237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 18:27:47.912319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 18:27:47.912410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 18:27:47.912486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] command line args: [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 18:27:47.912585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] command line args: [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 18:27:47.912701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 18:27:47.912856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 18:27:47.912945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ================================================================================ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 18:27:47.913022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ================================================================================ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 18:27:47.913118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] admin_token = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_dir = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_dir = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_source = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] debug = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.913995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_source = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] debug = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.914941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_config_append = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_config_append = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_dir = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.915927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_dir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.916981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.917880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.918964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.919079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.919210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.919315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.919482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.919562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.920514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.920603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.920748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] publish_errors = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.920852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] publish_errors = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.920928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.921869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] standard_threads = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] standard_threads = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_journal = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.922945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_journal = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_json = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_json = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_stderr = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_stderr = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_syslog = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_syslog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 18:27:47.923835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.923916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.924882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.925845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.926990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.927960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.928923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.929908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.930947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.931935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.932853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.933916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.934950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.935896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.936994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.937789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.938938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.939877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.940868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.941995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.942953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.943948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.944968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.945854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.946978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.947990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.948886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.949991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.external = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.external = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.950908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.951033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.password = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.951647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.password = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.951771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.token = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.951897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.token = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.952937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.953851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.954899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.955912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.956939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.957959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.958992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.959751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.960889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.961848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.962887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.963968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.964971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.965868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.966845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.967474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.967611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.967741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.967863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.967985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.968933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.969995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.970974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.971987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.972969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.973869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.974831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.975949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.976970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.977913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.978893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.979972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.980938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.981981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.982948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.983910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.984885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.985830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.986971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.987938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.988899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.989825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.990956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.991977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.992886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.993865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.994962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.995989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.996993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.997879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.998936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999068 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:47.999962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:48.000044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:48.000044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 18:27:48.000319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:48.000319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:48.000319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 18:27:48.000319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 18:27:48.028960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.029191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.029991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.030134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.030262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.030492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.038290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.038839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.065855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.066114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.066413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.066649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.119338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.119615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.168362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.168480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.168615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.168696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.323919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.324925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.325019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.325141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.348568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.348802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.348933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.349904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.350059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.350273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.360859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.361217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.373643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.373821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.373903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.374930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.375046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.375146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 18:27:48.391752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.391963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 18:27:48.392199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.392303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.392414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 18:27:48.392494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 18:27:48.392762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.392842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.392965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 18:27:48.393045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.393245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.393331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.393509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.393587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.393771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.394059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.403964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.404651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.404956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.411469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.412002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.414402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.414688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.414928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.415007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.415840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.416927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.417106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.417184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.417379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.417653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.440279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.440970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.441740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.442054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.442473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.442762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.446729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.447013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.447297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.447470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.447760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.448048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.453647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.453948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.454891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.455184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.459530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.459821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.460105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.460389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.460663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.460797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.460938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.461973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.462255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.462531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.462803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.477459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.477738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.478831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.479115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.481603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.483600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.485407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.485704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.486896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.487197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.489925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.491437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.493059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.494610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.496266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.496563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.496848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.497134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.497411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.497688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.497827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.498180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.498473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.498762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.499047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.499346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.513510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.513822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.514128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.514397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.515508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.515800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.516069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.516333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.521143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.522689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.523214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.524193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.524470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.524773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.526335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.526618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.527176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.527459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.527750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.528034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.528425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.529778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.530090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.530379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.530664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.531060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.540118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.540406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.540689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.540970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.541347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.541641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.541920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.542307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.542596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.542881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.543165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.543548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.543842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.544125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.558437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.560215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.561368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.563221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.564295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.565974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.566396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.567450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.567734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.567874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.568127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.569363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.569654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.570081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.574517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.575970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.576517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.578023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.578935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.579332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.579621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.579901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.580941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.581347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.581643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.581931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.587692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.587983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.588261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.589791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.590113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.590412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.595701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.595987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.596270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.596550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.596836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.597113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.597401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.597681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.597872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 18:27:48.598038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.598930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.599963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.600240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.600527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.600815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.601120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.601416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.601691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 18:27:48.634530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f6a06a9c0 pid: 81720 (default app) Sep 08 18:27:48.637039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f6a06a9c0 pid: 81721 (default app) Sep 08 18:27:48.637732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813da3-b744-4bde-9cc7-b275deec77ef None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:48.638046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813da3-b744-4bde-9cc7-b275deec77ef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:48.638320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813da3-b744-4bde-9cc7-b275deec77ef None None] PATH_INFO: `/v3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:48.642997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Sep 8 18:27:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:27:55.399619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:55.400147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:55.400242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:55.404902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:27:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:27:55.410406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:55.410835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:55.410966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:55.480829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: INFO dbcounter [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] Registered counter for database keystone Sep 08 18:27:55.499204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG oslo_db.sqlalchemy.engines [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 18:27:55.505430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writer thread running {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 18:27:55.685671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81720) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 18:27:55.686079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81720) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 18:27:55.743579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:27:55.745166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:27:55.875476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:27:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 18:27:56.300327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:27:56.369140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: INFO dbcounter [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] Registered counter for database keystone Sep 08 18:27:56.390720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG oslo_db.sqlalchemy.engines [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 18:27:56.396853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writer thread running {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 18:27:56.515832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe7c1-baf6-489d-a553-c31437e7342e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:27:56.520103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:27:56.520725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:56.521010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:56.521284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:56.529431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:27:56.580715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 18:27:56.581014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac6713-ca3f-4cc5-932d-79bdf8b85206 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:27:56.590244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Sep 8 18:27:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:27:56.596656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:27:56.613787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaefc1-581e-4be7-9e6f-7c4791c78dab None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:27:56.618172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:27:56.619270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:56.619561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:56.619834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] PATH_INFO: `/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:56.621421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] RBAC: Authorizing `identity:get_project(project_id=418c9b38e71d4cf1be4f4a5862e811b8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:27:56.673784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING keystone.common.rbac_enforcer.enforcer [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 18:27:56.674145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f70464-1fea-41fd-ac32-7076cdf63933 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:27:56.678736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Sep 8 18:27:56 2022] GET /identity/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:27:58.796518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7757b-e13f-47c5-9341-63c923ba363b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:58.797090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7757b-e13f-47c5-9341-63c923ba363b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:58.797090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7757b-e13f-47c5-9341-63c923ba363b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:58.801143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:27:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:27:58.806773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:58.807216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:58.807384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:58.827787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:27:58.829328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:27:58.837150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:27:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 18:27:59.119010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7757b-e13f-47c5-9341-63c923ba363b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:27:59.131898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7757b-e13f-47c5-9341-63c923ba363b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:27:59.136001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:27:59.136591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:59.136870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:59.137143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:59.145088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:27:59.146873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdde03-1c71-4e13-a1a8-f431cc2b76d9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:27:59.155896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Sep 8 18:27:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:27:59.161145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:27:59.170984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c556ee-cf30-4b38-a437-53280d6c35f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:27:59.175318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:27:59.175934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:27:59.176215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:27:59.176488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:27:59.177780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:27:59.179624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f90f5-bbcf-407a-90e7-5fcab8915688 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:27:59.181134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Sep 8 18:27:59 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:01.407453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83639-30d2-4baa-b41b-da3ae59215e4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:01.407994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83639-30d2-4baa-b41b-da3ae59215e4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:01.408085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc83639-30d2-4baa-b41b-da3ae59215e4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:01.409402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:01.414625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:01.415046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:01.415305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:01.420891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2b41-e66a-4cd4-90e7-c8737b4aa982 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:01.421179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2b41-e66a-4cd4-90e7-c8737b4aa982 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:01.421459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2b41-e66a-4cd4-90e7-c8737b4aa982 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:01.422753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:01.427513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:01.427801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:01.428075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:01.434059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:01.435244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:01.469894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG passlib.handlers.bcrypt [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81721) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 18:28:01.470305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG passlib.handlers.bcrypt [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81721) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 18:28:01.516524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:01.519071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:01.520640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:01.616509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:01.785870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:01.809487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:01.879627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:01.892071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d39f4-1c07-468e-9afe-31814efba0f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:01.926596 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:01.927229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:01.927514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:01.927788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:01.939844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:01.948737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:01.950429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:01.951426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:01.956214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:01.983365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a0bb4-e731-48c2-b38f-4cab5ea75e98 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:01.985583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.020378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.021405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.021701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.022007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.036985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.056262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a3c9-ff3d-4914-afff-b20d4a79227a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.088301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.089828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.089962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.090512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.090816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.091068 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.091732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:02.092034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.093403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.104753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:02.110359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:02.191074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:28:02.196557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:02.199190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.209189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4c80-04cb-46c1-b65d-9850cf2334ad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.242346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.242983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.243543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.243543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.244694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.246209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.248327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:02 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:02.253799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:02.270185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.296301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682378d5-27dc-4bc5-aead-ce34c40d62a0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.330245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.331491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.331778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.332055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.350720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.352166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.355677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e34cb-ae15-499c-9fc0-929d03a76fcd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:28:02.370041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:02.370947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:28:02.372093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:28:02.372093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:28:02.372093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:02.372093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:02.376813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:02.394149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.394780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.395058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.395330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.396434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.397870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.399419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:02.405676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:02.437315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.482990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:02.483437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310265d2-cdaa-4236-b911-f4c9a940450a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.501645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d508628-ea84-486b-b8d7-6dd2d4db4f05 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:02.517314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.517922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.518232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.518502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.519148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:02.519450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.520822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6ed61-03dc-4dc5-9d8b-2fc9728405c6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.535305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:02.535916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:02.536193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:02.536470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:02.537194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.domain.id=default, user.id=31c79467148b4b9fbc6b5124801a4328) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:02.537501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:02.538426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:02.539030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfaa54-cb74-47b1-9290-f259bb395794 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:02.546150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Sep 8 18:28:02 2022] GET /identity/v3/role_assignments?user.id=31c79467148b4b9fbc6b5124801a4328&scope.domain.id=default&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:04.857064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148dbf-ec75-48af-90ea-615330115ccd None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:04.858121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148dbf-ec75-48af-90ea-615330115ccd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:04.858610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148dbf-ec75-48af-90ea-615330115ccd None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:04.860387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:04.865921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:04.866739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:04.867219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:04.892181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:04.893712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:04.960731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9257df-c7fa-4ee3-a2dd-b5526acd6acb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:04.961757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9257df-c7fa-4ee3-a2dd-b5526acd6acb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:04.962366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9257df-c7fa-4ee3-a2dd-b5526acd6acb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:04.964412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:04.970559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:04.971096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:04.971580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:04.991570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:05.014996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:05.016531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:05.120470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:05.571280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:05.619990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:05.670294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:05.718595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e5456-8e71-4ff2-8f04-de3057c25685 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:05.722284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:05.779935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:05.781099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:05.782665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:05.783145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:05.792047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c337-5450-434c-b29d-89c2644ec32b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:05.809515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9094d7b2-513f-4820-ac23-f243a9e6d75e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:05.814713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:05.816514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:05.817251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:05.826504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:05.827894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a389efb-fef1-41d6-a08d-fc90e3465638 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:05.828229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a389efb-fef1-41d6-a08d-fc90e3465638 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:05.828510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a389efb-fef1-41d6-a08d-fc90e3465638 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:05.830413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:05.839462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:05.839814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:05.840096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:05.845026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:05.845686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:05.845995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:05.846281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:05.857603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:05.859928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:28:05.876575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:05.878826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:28:05.881162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:28:05.881162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:28:05.881162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:05.881162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:05.881162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:05.883631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:05.883631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:05.977112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 08 18:28:05.978267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.005436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.010160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57d17-c3ee-4b55-bcb6-7fb6456d546e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.048439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.049053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.049340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.049673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.050379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:06.050687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.052123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d87-638e-429d-8d86-3859f10c5bc0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.067081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 15/30] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:06.068112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a813f-a52c-4a24-bd81-1e002a100fd8 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.068399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a813f-a52c-4a24-bd81-1e002a100fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.068671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a813f-a52c-4a24-bd81-1e002a100fd8 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.069853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 16/31] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:06.079385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a813f-a52c-4a24-bd81-1e002a100fd8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.118368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.201331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9cdc-f83a-4c94-912b-a7d5b0c4f148 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.270704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a813f-a52c-4a24-bd81-1e002a100fd8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.285245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.285914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.286222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.286494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.287145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:06.287447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.290737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2e4cf-ec5f-4f8e-a3e0-1b28636ff936 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.332794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 16/32] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:06.334014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.334304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.334579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.352844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.353489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.353771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.354075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.355581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.357034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.358876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:06 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:06.359116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:06.359365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.360420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:06.397726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.451905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 17/34] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:06.452836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.495177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f926a-87b4-40dc-a7ff-79a1603e777f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.534161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.544355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.544971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.545255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.545532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.546244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.547681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.587551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fdf6-c1be-45ea-b7e4-252c94fe7775 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.623658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.624627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.625123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.625609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.626518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.628248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229b5e-1a5e-4017-9e60-7fd87c4ead0e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.684992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/roles => generated 225 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:06.685998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.785021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.791725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:06.794788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8099-6a42-4ced-9900-7d5d5689ed65 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.795435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8099-6a42-4ced-9900-7d5d5689ed65 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.795895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8099-6a42-4ced-9900-7d5d5689ed65 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.797617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 19/37] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:06.798850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef8099-6a42-4ced-9900-7d5d5689ed65 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:06.799410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba98ba-7907-4c3f-9e0f-5edebe6f0a83 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.847064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:06.847637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.847926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.848231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.850632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:06.851510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fadddb-515f-4d71-b552-04cb5e3f5f41 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:06.853265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:06.854636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ad7-89ce-45be-8d0a-0d6685e8f777 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.854926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ad7-89ce-45be-8d0a-0d6685e8f777 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.855203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8ad7-89ce-45be-8d0a-0d6685e8f777 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.856620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:06.857837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ae59-ba50-4e5d-b358-535488001c2f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.858407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ae59-ba50-4e5d-b358-535488001c2f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.858407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ae59-ba50-4e5d-b358-535488001c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.880357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e311ae59-ba50-4e5d-b358-535488001c2f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:06.882109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e311ae59-ba50-4e5d-b358-535488001c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:06.942451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef8099-6a42-4ced-9900-7d5d5689ed65 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:06.954323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:06.969955 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:06.974076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:06.974444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:06.974732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:06.995903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:06.996251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:07.004642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:07.005582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:07.005878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:07.006207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:07.006921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:07.008698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:07.030933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/roles => generated 219 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:07.031998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:07.083056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:07.259435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:07.274104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d86d7-14a4-47aa-83a8-28d728e89436 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:07.291548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:07.319348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:07.320355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:07.320869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:07.321362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] PATH_INFO: `/v3/domains/default/users/31c79467148b4b9fbc6b5124801a4328/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:07.323684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=31c79467148b4b9fbc6b5124801a4328, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:07.326010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:07.342497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Sep 8 18:28:07 2022] PUT /identity/v3/domains/default/users/31c79467148b4b9fbc6b5124801a4328/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:07.389784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6fef0-80d9-4987-af30-b49042666167 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:07.391030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:07.423925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:07.427154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:07.427846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:07.428142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:07.428491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:07.429185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:07.430645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:07.450391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 8 18:28:07 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:28:07.527723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f015f5-c376-4773-a391-5a6729c95a50 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:07.566999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:07.567721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:07.568012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:07.568298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:07.569458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:07.570990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093054d-24d2-45d3-9495-a1130b477074 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:07.572632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:07.578405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:07.660232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:07.687138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196e08-d1c3-49c4-b999-4f9c60c7c7e5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:07.720212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:07.720834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:07.721125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:07.721408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:07.722112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:07.723565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef999-f042-43a8-9483-00145933ac4c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:07.752231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:28:07 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:09.499164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfaa5-3516-475e-aee3-12bdbb9b081c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:09.499667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfaa5-3516-475e-aee3-12bdbb9b081c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:09.499774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfaa5-3516-475e-aee3-12bdbb9b081c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:09.501039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:09.506562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30739-6434-4f2e-840f-871789fcd78c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:09.506938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30739-6434-4f2e-840f-871789fcd78c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:09.507275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30739-6434-4f2e-840f-871789fcd78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:09.525029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1fe30739-6434-4f2e-840f-871789fcd78c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:09.526236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1fe30739-6434-4f2e-840f-871789fcd78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:09.591056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:09.857226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accfaa5-3516-475e-aee3-12bdbb9b081c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:09.916560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793097ca-a6d8-4b56-a838-4adbaf060002 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:09.916851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793097ca-a6d8-4b56-a838-4adbaf060002 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:09.917138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793097ca-a6d8-4b56-a838-4adbaf060002 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:09.918584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 26/49] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:09.923445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:09.923734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:09.924015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:09.942192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:09.943389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:09.950356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:09.958402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accfaa5-3516-475e-aee3-12bdbb9b081c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:09.993124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:09.993756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:09.994078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:09.994361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:09.996665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:10.005090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:10.010077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:10.014295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:10.015150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:10.015722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 27/50] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:10.015788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:10.017253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.218331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a58b55-9cae-469e-95df-ee5fd4e51656 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.251712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.252318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.252610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.252893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.253563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:10.253871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.255621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.264228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 28/52] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:10.270496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.279926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.330458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:10.376210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def24213-728d-4e5d-9da7-45b1e228c6d2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.386950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd0be5-f73f-4a69-9a53-427464ca8d23 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.410489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.411117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.411398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.411679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.412794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.414309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.415953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 25/53] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:10 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:10.419785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.420416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.421257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.421842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.422155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.423261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.424695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.429196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 29/54] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:10.431457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.445505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:10.521363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8306-fadf-445a-8790-ad778cefa5f7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.533043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6928-7fbb-4088-9158-eebaf36f36de None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.550717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:10.556773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.557405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.557692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.558023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.559662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.561128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.562761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 26/55] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:10.568422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:10.568538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.569125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.569400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.569680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.570363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.571800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599704fd-727b-44bd-9fdc-4ac66e86b666 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.597659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 30/56] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Sep 8 18:28:10 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:28:10.673267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:10.684574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa74581-002e-4eb1-9056-41b7ac81eeef None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:10.721453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:10.722104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:10.722389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:10.722659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:10.723396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.domain.id=default, user.id=31c79467148b4b9fbc6b5124801a4328) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:10.723703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:10.725145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e238e-58e9-41f1-83b3-d76f5640cf5a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:10.732278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 27/57] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Sep 8 18:28:10 2022] GET /identity/v3/role_assignments?user.id=31c79467148b4b9fbc6b5124801a4328&scope.domain.id=default&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:12.751257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b26ad-7445-4815-9226-b21937e85f57 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:12.751762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b26ad-7445-4815-9226-b21937e85f57 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:12.751842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b26ad-7445-4815-9226-b21937e85f57 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:12.753184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:12.758613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:12.759028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:12.759175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:12.777542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:12.779097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:12.844235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:13.110533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b26ad-7445-4815-9226-b21937e85f57 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:13.206455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b26ad-7445-4815-9226-b21937e85f57 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:13.238751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:13.239363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:13.239645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:13.239920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:13.241009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:13.242461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fee91-9c33-4af3-8881-4e6e93695c98 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:13.243975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:13.249295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:13.329560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:13.345846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4c53a-cda3-41bb-8daf-21ff39cd0fc8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:13.378513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:13.379052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:13.379597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:13.379870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:13.380523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:13.381969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe2feb-95f1-4971-a08f-724db10f66f6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:13.407187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:13 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:28:16.458387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbf43-5051-4863-a30f-66cab175ca50 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:16.458387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbf43-5051-4863-a30f-66cab175ca50 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:16.458387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbf43-5051-4863-a30f-66cab175ca50 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:16.458387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:16.464448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ba80-e0b4-4548-b903-6d9e807e5ce6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:16.464823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ba80-e0b4-4548-b903-6d9e807e5ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:16.465016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ba80-e0b4-4548-b903-6d9e807e5ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:16.489317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-58a0ba80-e0b4-4548-b903-6d9e807e5ce6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:16.490552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-58a0ba80-e0b4-4548-b903-6d9e807e5ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:16.586948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 30/63] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:16.641363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40be9ad-c6af-4865-bef5-445297cede49 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:16.641363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40be9ad-c6af-4865-bef5-445297cede49 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:16.641363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40be9ad-c6af-4865-bef5-445297cede49 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:16.641363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:16.646755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:16.647300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:16.647789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:16.670463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:16.671941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:16.766230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:16.771082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 31/65] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:16.900921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40be9ad-c6af-4865-bef5-445297cede49 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:16.953974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.031700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40be9ad-c6af-4865-bef5-445297cede49 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.067514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.084467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.085109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.085398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.085682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.109625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:17.115728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:17.116568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:17.117314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 35/66] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:17.125196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.226232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dafe6a-2f0a-41af-a658-aea37d300e03 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.248391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.252921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c727bc-3f78-465f-aef7-580f1303a1bf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.264204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.265048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.265547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.265983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.281846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-76761b16-045d-47d2-bcf2-0775fb83992e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:17.288234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:17.289058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:17.289798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:17.294155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.294785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.295075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.295361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.296092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:17.296302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 32/67] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:17.296394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:17.297791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce038-de7a-449c-aa22-504c2802eab2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:17.298542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484c9e-5248-4b3d-8d6f-d1ffb80869fc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.299048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484c9e-5248-4b3d-8d6f-d1ffb80869fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.299520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484c9e-5248-4b3d-8d6f-d1ffb80869fc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.301018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 33/68] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:17.306755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d484c9e-5248-4b3d-8d6f-d1ffb80869fc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.319956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:17.321731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.322249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.322710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.340985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:17.342231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:17.371924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.412237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 37/70] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:17.412925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.426934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d484c9e-5248-4b3d-8d6f-d1ffb80869fc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.465864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.467257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.467759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.468750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.469917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:17.470469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:17.473067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf699b-52c0-47c2-9594-e0472ee2bb8a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:17.485491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:17.487066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ab13-b655-4fe4-9d56-619b182d618f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.487553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ab13-b655-4fe4-9d56-619b182d618f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.488125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ab13-b655-4fe4-9d56-619b182d618f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.489549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 35/72] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:17.496083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ab13-b655-4fe4-9d56-619b182d618f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.520035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.531412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f7de6-29c5-46eb-8982-acb89536bad0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.569974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.570772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.571293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.571773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.589514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:17.591464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28069477-25f3-4287-836d-fd969664ff02 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:17.593428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:17.599397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.599909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.600503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.622794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:17.624346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:17.625850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ab13-b655-4fe4-9d56-619b182d618f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.660633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.678236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.679118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.680027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.680456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.682506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:17.684358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:17.686887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 36/74] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:17.687842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.709155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 39/75] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:17.710378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.803275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.816176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6cec-2bca-423f-b9e0-397913b6273b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.826398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b679fc-219c-4215-bd16-28b2db1d5a45 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:17.851993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.852599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.852889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.853309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.861459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:17.862130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:17.862514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:17.862806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:17.873773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:17.878631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:17.879712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 40/76] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:17.882669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:17.923306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:17.934794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:17.936276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378cf97-8cc9-4eea-b2b4-7401a3caad3c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:17.985718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239537ee-2bcd-4e10-a622-0b3dbb232680 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.019728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.020436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.020727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.021013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.029801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.036967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 37/77] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:18.038449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc47d-cfa2-401c-bf89-a9bfa0a24d19 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.038741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc47d-cfa2-401c-bf89-a9bfa0a24d19 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.039020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fc47d-cfa2-401c-bf89-a9bfa0a24d19 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.040265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 38/78] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:18.041124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fc47d-cfa2-401c-bf89-a9bfa0a24d19 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.093031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.094474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.131292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.142900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fc47d-cfa2-401c-bf89-a9bfa0a24d19 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.176269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.176875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.177162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.177437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.178141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:18.178445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.179832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.187761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.188540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.194625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 41/80] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:18.194625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.230950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.292144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4c37-78b1-4be3-99ba-da4929463f16 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.292378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafd6b-c156-43ad-81bc-a46f8b6a00db None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.326185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.326361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.326816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.326914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.327100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.327184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.327378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.327472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.328517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.330436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d810e-e64a-499c-afaf-b9be9db74594 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.332256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.333174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.333465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.333748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.340147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:18.345710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:18.346605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 40/82] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:18.350610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.352048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:18.353251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:18.362691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.419183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:18.420024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.455201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.464658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542f6d-f94d-4a6c-9c81-a15f1a43e247 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.503702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.504593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.504961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.505245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.506502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.507947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.514432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.514432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.527235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2e5c3-d939-422d-9dbe-8b5a8377fc6d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.560216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.560839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.561126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.561397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.562548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.564021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.565624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 44/85] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.566402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.603485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.624880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab28f-cbc8-4386-a3f1-58a2996b4e8c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.661971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.662800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.663304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.663843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.664642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:18.664958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.666440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.667258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98312-26ae-41e1-88f0-b1e34a8a347f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.669514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.681969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 42/86] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.681969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.714299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.714936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.715224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.715503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.716187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:18.716496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.717992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.727937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.728850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.801705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026213d-86de-4722-a4b0-300b0cbb4508 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.843006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.843638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.843927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.844210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.852767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793260b-660e-478a-b9f1-57550b35e917 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:18.861612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:18.887718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:18.888334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:18.888625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:18.888903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:18.889637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=31c79467148b4b9fbc6b5124801a4328) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:18.889961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.891414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.899803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 46/88] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/role_assignments?user.id=31c79467148b4b9fbc6b5124801a4328&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:18.907179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:18.933416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:18.935169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:18.949187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.043219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2cf6-e10f-4a7a-8528-e2d7a365019c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.079152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 43/89] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:19.080035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.091605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.092255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.092547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.092855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.094751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.095728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.097332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:19.098413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.140479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.204858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a1cf5-0330-40c9-8396-4d19ca65d43b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.227378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.231405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00491b3-d45e-48fc-8022-e082d2531ac4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.248732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.249852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.250688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.251122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.252452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.255166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.262966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 44/91] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:19.264062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.269078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.269721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.270122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.270413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.271541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.273038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.274857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 48/92] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:19.275456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.378395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81dada-794d-4d91-8fcd-6e738aa52558 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.381202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc25a9-1308-42af-adca-51fa02b5367e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.396711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.414352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.415024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.415313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.415644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.424374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.425212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.425734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.426219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.427020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.428728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.453499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.458631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 45/93] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:19 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:19.459655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.494301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.496396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.611273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:19.616819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.676258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdb63-308d-47ea-a4dc-e9e3ac27ea65 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.688696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.734801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422972-2951-4347-b1da-cf4af3a2ec02 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.771167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.771801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.772086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.772360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] PATH_INFO: `/v3/projects/42e6304b4cc9484bbdb72b6309a30a86` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.773465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] RBAC: Authorizing `identity:get_project(project_id=42e6304b4cc9484bbdb72b6309a30a86)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.774981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.777376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 50/95] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/projects/42e6304b4cc9484bbdb72b6309a30a86 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:19.778404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.779255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.779757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.780230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.781172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:19.781701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.782905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:19.783758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fae573-15be-4fbb-b85c-1ee22cd79e4a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.793921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 46/96] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:19.906106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426a228-7de5-466f-9c08-09e85309f42d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:19.944233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:19.945127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:19.945603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:19.946082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:19.947007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=42e6304b4cc9484bbdb72b6309a30a86, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:19.947500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:19.949796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c489a6-cb99-4e47-8ca2-fc49c525053a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:19.952057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:19.957629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 51/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:19 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=42e6304b4cc9484bbdb72b6309a30a86&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:21.041884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146925e-424a-49da-8adb-9c0691d4ece8 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:21.042408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146925e-424a-49da-8adb-9c0691d4ece8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:21.042482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146925e-424a-49da-8adb-9c0691d4ece8 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:21.043815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 47/98] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:21.049227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635eca-ffb1-4da4-9c16-078a9c0ef89c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:21.049626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635eca-ffb1-4da4-9c16-078a9c0ef89c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:21.049832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99635eca-ffb1-4da4-9c16-078a9c0ef89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:21.068894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-99635eca-ffb1-4da4-9c16-078a9c0ef89c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:21.070131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-99635eca-ffb1-4da4-9c16-078a9c0ef89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:21.156490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 52/99] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:21.477956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d740-2510-46c5-a4b3-c9aed6dace6f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:21.478318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d740-2510-46c5-a4b3-c9aed6dace6f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:21.478516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d740-2510-46c5-a4b3-c9aed6dace6f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:21.480142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 48/100] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:21.484940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:21.485238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:21.485524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:21.510864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:21.512049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:21.600862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 53/101] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:21.717006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d740-2510-46c5-a4b3-c9aed6dace6f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:21.761894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:21.860042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d740-2510-46c5-a4b3-c9aed6dace6f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:21.907939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:21.908576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:21.908857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:21.909132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:21.921786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:21.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:21.927924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:21.928666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 49/102] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:21.935124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.034762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:22.040257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.095152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631038-686d-4c0f-81bb-64cb47fbcc3d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.156639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.157612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.158121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.158616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.159789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:22.160306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.162364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.177803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 54/103] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:22.183126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.290579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:22.296815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481216-42e8-416d-a42f-70918d807655 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.327706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf76a-5a07-4179-9a29-26da8ce8afec None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.350353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:22.380789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.381441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.381731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.382041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.382918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.383614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.383904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.384182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.386628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.388099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.389888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 55/104] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:22.396658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.410880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:22.416948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:22.417798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:22.418583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 50/105] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:22.425621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.543968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2274fd-0fec-41d7-a1c9-a28c1c0ea139 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.611943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc6bd-0ef2-4b07-aa93-1b02ec6813b7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.622674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.623721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.624023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.624313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.625494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.627123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.629087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 56/106] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:22.640464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.671558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.672183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.672466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.672744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.673420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:22.673724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.675155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.694156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 51/107] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:22.708733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:22.739204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:22.744136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:22.826503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b5bf-a787-479b-88ea-58d76463be4a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.848097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732291b-b62a-4166-8b0e-a90fb09b2e85 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:22.866250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.866894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.867902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.868188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.870055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.871514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27382d25-445e-4f54-bfa9-cdb1e583bc32 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.873093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 52/108] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:22.874237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e6f4-8735-4426-be2b-2d6917096717 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.874526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e6f4-8735-4426-be2b-2d6917096717 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.874866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172e6f4-8735-4426-be2b-2d6917096717 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.876139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 53/109] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:22.881793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef2fd-0ba8-4573-b171-680b4d2f4282 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.882110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef2fd-0ba8-4573-b171-680b4d2f4282 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.882390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef2fd-0ba8-4573-b171-680b4d2f4282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.920228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cb9ef2fd-0ba8-4573-b171-680b4d2f4282 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:22.921228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:22.922206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:22.922696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:22.923175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:22.925692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb9ef2fd-0ba8-4573-b171-680b4d2f4282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:22.927850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, user_id=a5ca536e9de3472b97cc07f0a37e1327, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:22.929624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:22.958092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 57/110] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:22 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:28:22.958740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:23.071445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:23.125035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5b242-8edb-4a0f-865a-f8e6e1917c0d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:23.143864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:23.166899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:23.167560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.167851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.168137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.170708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:23.172204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:23.173934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:22 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:23.178280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643aaa8-10df-4db4-a7b8-155c4c539e9c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.178576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643aaa8-10df-4db4-a7b8-155c4c539e9c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.178866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643aaa8-10df-4db4-a7b8-155c4c539e9c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.179898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:23.180203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 55/113] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:23.191255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d82d-5755-4be0-8c0a-aa4b12a4321f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.191551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d82d-5755-4be0-8c0a-aa4b12a4321f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.191829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d82d-5755-4be0-8c0a-aa4b12a4321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.227347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bbc7d82d-5755-4be0-8c0a-aa4b12a4321f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:23.228314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bbc7d82d-5755-4be0-8c0a-aa4b12a4321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:23.245828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:23.296188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb962975-492b-4246-9a60-82feb5cd7837 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:23.334771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:23.335452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.335742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.336026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/31c79467148b4b9fbc6b5124801a4328/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.338093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, user_id=31c79467148b4b9fbc6b5124801a4328, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:23.339629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020bf0-1862-4197-897d-e875c41baf6f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:23.346730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 56/114] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:23.357495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 59/115] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:23 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/31c79467148b4b9fbc6b5124801a4328/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:23.399428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7370-e836-4d7d-8990-50cf0d459eb9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.399679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7370-e836-4d7d-8990-50cf0d459eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.399923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7370-e836-4d7d-8990-50cf0d459eb9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.401615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 57/116] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:23.407006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.407309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.407597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.435028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:23.436314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:23.442298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7370-e836-4d7d-8990-50cf0d459eb9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:23.486937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:23.522574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 60/117] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:23.612973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7370-e836-4d7d-8990-50cf0d459eb9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:23.665075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:23.666059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.667132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.667604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.683502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:23.688845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:23.689671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:23.690474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:23.692740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 58/118] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:23.698857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:23.709274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:23.713705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:23.907940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47122705-da91-4d6f-9312-bafaaace931f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:23.925568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcba7b-89af-4142-bf38-1b6ff9cd36f7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:23.986990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:23.987633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.987920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:23.988198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:23.998339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:23.999243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:23.999729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.000185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.001094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:24.001580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.001680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:24.003284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad430-4672-4ad1-b540-d8c07f72ae90 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fc8a096e-0b85-4522-a2a6-b43dc5fdf423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:24.007440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:24.008281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:24.009233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 59/119] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:24.011104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487445b-14fb-4f50-9c93-5722b3c8f882 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.011494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487445b-14fb-4f50-9c93-5722b3c8f882 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.011880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487445b-14fb-4f50-9c93-5722b3c8f882 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.013238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 60/120] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:24.014256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487445b-14fb-4f50-9c93-5722b3c8f882 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.016602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 61/121] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.019250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449177-898b-4648-aeae-f53749cc480c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.019708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449177-898b-4648-aeae-f53749cc480c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.020118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449177-898b-4648-aeae-f53749cc480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.040936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f0449177-898b-4648-aeae-f53749cc480c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:24.042998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f0449177-898b-4648-aeae-f53749cc480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:24.076306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.090561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.127942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 62/122] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:24.129004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0449177-898b-4648-aeae-f53749cc480c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.148525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487445b-14fb-4f50-9c93-5722b3c8f882 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.195267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.196376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.196861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.197516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.199507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.201784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.204157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 61/123] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.208982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.277255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0449177-898b-4648-aeae-f53749cc480c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.344604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.345230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.345566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.345854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.346567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:24.346879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.350702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.372946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 63/124] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.373605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.436905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f1e5-3be1-473f-8d35-8ea0a7ef97e3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.439302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.496628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.503007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.503927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.504593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.504944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.506383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.508305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.510733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 62/125] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.511498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.548273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1f4a9-c0d5-4b42-a214-1bd30c86ff4c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.587023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.587959 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.588898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.589374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.590186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.591776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.619510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 64/126] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:28:24 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:24.627138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.637970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97341-9fd0-4867-8dc7-b69d7d90c982 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.680218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.681347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.681715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.682037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.683226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.684731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.687261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 63/127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.687861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.773865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.822224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a96f9-35c4-45e5-82e8-a32841f08d4b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.860050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:24.864305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.864873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.865178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.865472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.866871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:24.868167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:24.869926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:24.872926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.907479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b60d-b32b-4a6d-901e-0f37f38583d0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:24.953320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:24.953985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:24.954282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:24.954564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:24.970232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:24.977912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:24.978984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:24.979924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:24.999542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26c2d-a6cf-471d-86ac-013353cddcde None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.038773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.039618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.040042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.040457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] PATH_INFO: `/v3/projects/42e6304b4cc9484bbdb72b6309a30a86` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.042784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=42e6304b4cc9484bbdb72b6309a30a86)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.044522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.046812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:24 2022] GET /identity/v3/projects/42e6304b4cc9484bbdb72b6309a30a86 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:25.047766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:25.056244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:25.109579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664cc9c-0617-46f8-8827-e0d7e023e0ac None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.157430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.158225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.158491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.158773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.159528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed190d3-9fd8-438e-a470-e9296a8e4fe1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.160973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, user_id=a5ca536e9de3472b97cc07f0a37e1327, role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.169974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.175777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:25.181591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 66/131] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:24 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:25.182928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:25.290825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.291451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.291874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.292066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.292766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:25.293070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.294526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.312928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:25.323672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:25.423068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e02924-a6e4-47ec-b029-de34e4a74caa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.443435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:25.492998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.494051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.495368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.495838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] PATH_INFO: `/v3/projects/42e6304b4cc9484bbdb72b6309a30a86/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.498028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] RBAC: Authorizing `identity:create_grant(project_id=42e6304b4cc9484bbdb72b6309a30a86, user_id=a5ca536e9de3472b97cc07f0a37e1327, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.501054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.523662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 67/133] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:25 2022] PUT /identity/v3/projects/42e6304b4cc9484bbdb72b6309a30a86/users/a5ca536e9de3472b97cc07f0a37e1327/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:25.540168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3925ea-1d50-4c40-b723-fdef0ff01143 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.610971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.611556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.611844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.612123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] PATH_INFO: `/v3/users/4ed15b04d368497596a002c395575a09` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.633242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] RBAC: Authorizing `identity:get_user(user_id=4ed15b04d368497596a002c395575a09)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.634802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7774-7ffa-4894-a9ae-cbf2a854e44f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.636856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:25 2022] GET /identity/v3/users/4ed15b04d368497596a002c395575a09 => generated 289 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:25.642674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:25.717542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:25.774256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aafe8-b8b5-4f3f-a1c4-15c02037f080 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:25.822641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:25.823730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.824218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.824692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.910240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:25.911662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:25.930484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431aef-e59f-46a7-93a5-71ba2006964e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.930784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431aef-e59f-46a7-93a5-71ba2006964e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.931066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431aef-e59f-46a7-93a5-71ba2006964e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.932428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 68/135] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:25.937339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:25.937627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:25.937906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:25.979817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:25.980205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:25.981418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:26.035032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 68/136] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:26.041683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:26.168344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:26.226100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbe8a-1dc0-4e84-8790-bfe2c2f81ccd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:26.281300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:26.282443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.286039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.286039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.286690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:26.288211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51da3-6f33-4eb5-b963-fd8765cb3252 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:26.289903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 69/138] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:26 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:26.295948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:26.332886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddad7-401a-4447-8b24-655a74c8c2d1 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.333209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddad7-401a-4447-8b24-655a74c8c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.333452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ddad7-401a-4447-8b24-655a74c8c2d1 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.335192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 70/139] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:26.340792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.341084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.341391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.375530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:26.376750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:26.378894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:26.416138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:26.466284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771536f-154f-43b2-8c7c-6926d7df3680 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:26.501736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 71/140] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:26.506065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:26.537275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:26.539366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.539848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.541421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.542434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=4ed15b04d368497596a002c395575a09) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:26.543914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:26.547279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:26.559007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 70/141] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:26 2022] GET /identity/v3/role_assignments?user.id=4ed15b04d368497596a002c395575a09&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:26.670079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45619178-f013-4069-8daf-c91c0d2c103e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:26.708159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:26.708807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.709104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.709383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.720637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:26.725448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:26.726315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:26.727092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 72/142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:26.734039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:26.860361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884151d5-5e7b-40e1-ac9a-fc1bf0bef019 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:26.882147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:26.903886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:26.904526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:26.904812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:26.905092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:26.905783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:26.906115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:26.907526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:26.921801 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 71/143] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:26.927415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:26.954656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:27.005522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:27.066475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610537a-fb13-4ade-b6f5-364f4fbe506f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:27.128049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:27.129180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:27.129601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:27.130132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:27.134701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:27.136337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:27.138132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:26 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:27.146150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:27.239886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7f10-e2b5-43e1-9992-87af6487ed2d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:27.313890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:27.336095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c158-b77c-4348-a916-4fcd0929f1f5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:27.344640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:27.345345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:27.345630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:27.345919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:27.378950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:27.384478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:27.385353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:27.386125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:27.389962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:27.389962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:27.389962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:27.389962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:27.394512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:27.486831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:27.523387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:27.526183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81015e5-9811-415d-9974-d57340f27009 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:27.620239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d922e-97cf-4297-8254-4fd877ced209 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:27.690728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:27.692400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:27.692687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:27.692965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:27.693674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:27.694016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:27.695708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:27.718156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 73/146] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:27.725452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:27.790614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:27.864741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 74/147] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:28:27.866444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0d8f3-e92f-4ed8-b266-e63666fe7537 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:27.866971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0d8f3-e92f-4ed8-b266-e63666fe7537 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:27.867449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0d8f3-e92f-4ed8-b266-e63666fe7537 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:27.869040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 75/148] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:27.870189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0d8f3-e92f-4ed8-b266-e63666fe7537 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:27.990329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:27.993420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a04d40-1200-4982-a689-d4fb504b6215 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:28.048404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:28.049415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.049958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.051084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] PATH_INFO: `/v3/users/31c79467148b4b9fbc6b5124801a4328` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.053535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] RBAC: Authorizing `identity:get_user(user_id=31c79467148b4b9fbc6b5124801a4328)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:28.055215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec69e02-8865-4414-8707-0d13da1f420f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:28.057052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:27 2022] GET /identity/v3/users/31c79467148b4b9fbc6b5124801a4328 => generated 247 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:28.063202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.063732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.064218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.112289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:28.117928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:28.137246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0d8f3-e92f-4ed8-b266-e63666fe7537 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:28.252041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:28.253928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.257057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.261097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.265162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:28.270005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:28.276910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:27 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:28.277999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:28.371293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 75/151] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:28.372176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:28.415034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:28.488827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbcb6d-1455-40ef-b863-8c0e3e7f7757 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:28.555379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:28.555965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.556248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.556591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.564315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dade850-df98-4836-9230-ece47daf4ee8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:28.585771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:28.603264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:28.604018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.604303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.604583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.605318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:28.605630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:28.607116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41344e2-ff21-4949-9bf4-5bd0bc15dc07 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:28.614187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 76/152] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:28 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:28.616193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9733-d07a-49e2-8491-fe4efe3e03a9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.616488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9733-d07a-49e2-8491-fe4efe3e03a9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.616764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9733-d07a-49e2-8491-fe4efe3e03a9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.618400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 77/153] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:28.627910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.628247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.628711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.667147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:28.668394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:28.752525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:28.754341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb9897-c148-4056-a7a7-1a52cccff162 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:28.806221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:28.807148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:28.865849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:28.938833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 77/155] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:28.940392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1dff6-3f33-4082-a4fb-826226b32bc5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:28.940678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1dff6-3f33-4082-a4fb-826226b32bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:28.941905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1dff6-3f33-4082-a4fb-826226b32bc5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:28.943341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 78/156] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:28.944068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1dff6-3f33-4082-a4fb-826226b32bc5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:28.971152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:28.982672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568f7e-244e-4adf-8a77-0a75e458c786 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.026193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.026929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.027208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.027574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.028687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.030146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df418c8-7f49-4c87-9ded-764190b49023 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.032045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 79/157] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:29.033006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.033287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.033559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.063988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:29.065088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:29.075622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1dff6-3f33-4082-a4fb-826226b32bc5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.121003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.122103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.122505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.123360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.124822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.126985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.128896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 79/158] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:28 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:29.130232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.146852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 80/159] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:29.147797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.162560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:29.252542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146ad-2017-4f52-8cae-0692d2f35653 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.272401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:29.287826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b166019-935f-4335-874b-cdbc87af53d4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.299294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.300116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.300492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.300853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.301692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.303313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.328970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.329504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.329846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.330159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.330891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=31c79467148b4b9fbc6b5124801a4328) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:29.331199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.332902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.338596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 80/160] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:29 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:29.345994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 81/161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/role_assignments?user.id=31c79467148b4b9fbc6b5124801a4328&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:29.346977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.470708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.487653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:29.522846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c98f-5d20-475a-92f4-93ebc1dfa7e6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.573182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.573852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.574190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.574791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.591682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-442c99fe-568d-4f98-95c1-f672839c7605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:29.597850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:29.598839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:29.599640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 81/162] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:29.600864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a126c4-0a29-49c3-a371-a82f916ff824 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.601021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a126c4-0a29-49c3-a371-a82f916ff824 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.603215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a126c4-0a29-49c3-a371-a82f916ff824 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.603215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 82/163] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:29.607847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a126c4-0a29-49c3-a371-a82f916ff824 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.638650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afbc93-1127-48f7-88f1-0396a0262f29 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.686815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.687776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.688070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.688588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.700878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fac3ef64-0c11-4b77-987a-9d3039c195ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:29.707411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:29.708309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:29.709094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:29.711035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.713408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.713732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.740042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:29.741273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:29.755446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a126c4-0a29-49c3-a371-a82f916ff824 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.756093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:29.796650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.797270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.797556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.797838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.798540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:29.798847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.800237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.806999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:29.811152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:29.813968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.835803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:29.836971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:29.943216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4741505-0436-4e0a-a19a-fdff226475b6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.983596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:29.984568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:29.985064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:29.985572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:29.986492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:29.987022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:29.988679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:29.989026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a7aa-dcf6-496d-921c-bd58a0c47ea4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:29.998679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:30.005088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.042992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.043881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.044228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.044843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.046190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:30.049062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:30.049659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:29 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:30.055324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.075568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.094859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.138644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ff50-f246-45af-8704-03446a46b971 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.176421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.177289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.177710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.178149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] PATH_INFO: `/v3/users/a5ca536e9de3472b97cc07f0a37e1327` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.179433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a5ca536e9de3472b97cc07f0a37e1327)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:30.181095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:30.184626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/users/a5ca536e9de3472b97cc07f0a37e1327 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:30.190535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.245130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89568d-dabf-40bd-bfca-3c36253eca1d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.289843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.290497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.291326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.291611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.308619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da7049-0625-4062-bce8-dda4caed64c5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.347835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.355741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.356549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.356739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.357016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.374734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:30.376440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:30.391912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.432943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:30.433916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:30.524357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:28:30.525401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.588348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 86/171] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:28:30.589002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.630651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.724796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf05fd-131d-4556-9d6e-bbabe08a0d22 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.749677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:30.761698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766cae8-fdf2-46a8-852f-5379d4d89daa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.800787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.802641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.805702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.806802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.831375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:30.836965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:30.838545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:30.839332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:30.841811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:30.846673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:30.847147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.847330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:30.847599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:30.847872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:30.849005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:30.850491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:30.852106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:30.858826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:30.962204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561476-ef8f-409b-9b63-c97eb4c23470 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:30.999863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.000934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.001417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.002054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] PATH_INFO: `/v3/projects/42e6304b4cc9484bbdb72b6309a30a86` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.003682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] RBAC: Authorizing `identity:get_project(project_id=42e6304b4cc9484bbdb72b6309a30a86)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.005447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.007433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/projects/42e6304b4cc9484bbdb72b6309a30a86 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.008659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:31.028740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:31.034585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb23c8d-f2f4-43ee-80aa-014559515f6d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.102948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:31.113809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.114785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.115291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.116033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.116937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:31.117582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.119816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.131003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 88/175] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.137271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:31.216359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a47b5-a581-41f5-b4fb-d617eba37606 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.252616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661900f-a660-49bc-ae4c-1317aa42b97b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.293415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.294474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.294988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.295462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.296394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=42e6304b4cc9484bbdb72b6309a30a86, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:31.296904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.298567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.305216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 89/176] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:31 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=42e6304b4cc9484bbdb72b6309a30a86&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.307057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:31.340832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:31.342741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.343376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.343661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.343942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.344815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=a5ca536e9de3472b97cc07f0a37e1327) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:31.344988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.346470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.368058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 88/177] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:31 2022] GET /identity/v3/role_assignments?user.id=a5ca536e9de3472b97cc07f0a37e1327&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.429456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8f36a-e43b-43c6-99a9-1753f590d322 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.469088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.470113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.470624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.471099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] PATH_INFO: `/v3/users/4ed15b04d368497596a002c395575a09` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.472437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed15b04d368497596a002c395575a09)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.474125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.476019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 90/178] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:31 2022] GET /identity/v3/users/4ed15b04d368497596a002c395575a09 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.482960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:31.596050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af6cea-ff46-4f7c-84c7-00c2f307a51f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.599555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:31.636110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.637081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.637584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.638103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.639502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.641256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f6912-3d37-4e85-acdd-9e71872fe7f5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.643336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:31 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:31.663763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:31.773203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:31.783608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b113b-9652-4372-913f-cd3535382bc2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:31.824685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:31.825336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:31.825622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:31.825905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/4ed15b04d368497596a002c395575a09/roles/65dc35ec47ad472d836746df55c57bb5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:31.827882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, user_id=4ed15b04d368497596a002c395575a09, role_id=65dc35ec47ad472d836746df55c57bb5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:31.829380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0d1b-ab4b-4aea-8a69-435cfa553fca None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:31.849827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 91/180] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:31 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/users/4ed15b04d368497596a002c395575a09/roles/65dc35ec47ad472d836746df55c57bb5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:32.237062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf62d-0cec-4f94-b0ac-731c8d854ab6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.237573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf62d-0cec-4f94-b0ac-731c8d854ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.237647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf62d-0cec-4f94-b0ac-731c8d854ab6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.239025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 90/181] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:32.244483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbd11c-886f-4a31-b0a1-29dcae38952c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.244772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbd11c-886f-4a31-b0a1-29dcae38952c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.245053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbd11c-886f-4a31-b0a1-29dcae38952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.264466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-97cbd11c-886f-4a31-b0a1-29dcae38952c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:32.265676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-97cbd11c-886f-4a31-b0a1-29dcae38952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:32.340021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 92/182] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:32.438030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595c05-a1ea-45f0-9c35-a1ab5e2b81be None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.438325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595c05-a1ea-45f0-9c35-a1ab5e2b81be None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.438586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595c05-a1ea-45f0-9c35-a1ab5e2b81be None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.439921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 91/183] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:32.445324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.445621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.445894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.464582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:32.465767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:32.533920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 93/184] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:32.615917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595c05-a1ea-45f0-9c35-a1ab5e2b81be None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:32.726738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595c05-a1ea-45f0-9c35-a1ab5e2b81be None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:32.768217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:32.768855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.769140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.769417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.780749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bd68c1e8-0465-46f0-8c13-7f48d753f2c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:32.786339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:32.787189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:32.787954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:32.794722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:32.811032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:32.831338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9bc8-cc33-4961-a09a-c0ac5d33f109 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.831338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9bc8-cc33-4961-a09a-c0ac5d33f109 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.831723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9bc8-cc33-4961-a09a-c0ac5d33f109 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.833437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 93/186] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:32.839507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.839797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.840071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.859298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:32.860501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:32.888951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:32.912872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708d22-9ffd-4fa6-b9e9-8a9f01472be0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:32.933607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 94/187] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:32.942796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:32.952218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:32.952834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:32.953121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:32.953399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:32.954522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:32.954836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:32.956226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:32.966255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:32.972023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.050976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.075594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73f52-267f-4cde-b58a-d3047bbebda8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.082553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a20a0-3928-4e00-8059-0d479210878a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.112645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.113973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.114691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.115158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.124164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.124806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.125100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.125379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.130545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:33.136811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:33.137687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:33.138519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 95/189] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:33.144408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.145222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.146373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.148255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:32 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:33.160551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.170316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.251012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611639-5cad-434c-94a9-eaf49523e193 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.272133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e27d-444e-4edb-be47-f9378aad455e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.290140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.291277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.291572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.291827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.292494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:33.292797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.294223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.307325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:33.307325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.310061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.316112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.316804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.317198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.317546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.396006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.397466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.403981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.421712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c99192-eb82-437d-88a1-071c267b2eea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.454732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.455353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.455631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.455908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.457069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.458465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.460000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:33.460756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.514906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 96/193] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:33.514906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.545074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.575976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830d00-6d9b-4086-a985-a4b943ceae2b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.611427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.612072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.612347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.612623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.613751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.615252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.616980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:33.617672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.622473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d046-69c3-481e-ac38-1bc5a639d137 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.640370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.662429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.663334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.663811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.664223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.665121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.667273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.691696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 97/195] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:33 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:33.699733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.727851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c930d-0830-4737-853d-848c7edd4966 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.764836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.765616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.765988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.766346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.767601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.769218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.771317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:33.777929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:33.823985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.842632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685ebc-92aa-45f8-85af-11ee0317189d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.879727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:33.893123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477b793-c976-43e1-8f28-e6215c5296de None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:33.893561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.894348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.894865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.895207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.935344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:33.935788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:33.936071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:33.936348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:33.937117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=4bb0f41ea64449f9ac8342dbadf93aec) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:33.937431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.939507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:33.949379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 100/197] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/role_assignments?user.id=4bb0f41ea64449f9ac8342dbadf93aec&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:33.988710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:33.990692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfcb06-b180-4d37-87f0-90508a924e9f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:34.097845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:34.116586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:34.123409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:34.124194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4daf-6dc8-4463-8dd6-bf8db05edf2b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:34.124485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4daf-6dc8-4463-8dd6-bf8db05edf2b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:34.124760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4daf-6dc8-4463-8dd6-bf8db05edf2b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:34.126405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 99/199] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:34.132036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:34.132327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:34.132604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:34.157616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:34.158857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:34.239840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 100/200] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:34.273967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e84-cf04-41a3-96ce-b1f562046754 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:34.306970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:34.307610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:34.307888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:34.308157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:34.309302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:34.310861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:34.312492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:34 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:34.319118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:34.448750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1f8f-8996-4c44-bb4e-139ba7d1825a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:34.482318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:34.511639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:34.512257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:34.512541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:34.512818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:34.513556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=4bb0f41ea64449f9ac8342dbadf93aec) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:34.513881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:34.515332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:34.526166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:34 2022] GET /identity/v3/role_assignments?user.id=4bb0f41ea64449f9ac8342dbadf93aec&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:34.637690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:34.661961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:34.758189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8621037-ff3d-4fda-85d2-a141490539d1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:34.797398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:34.798430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:34.798910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:34.799400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:34.811175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:34.821039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:34.822022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:34.823666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:34.831079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:34.996103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e99f-3505-4064-a8f2-6dd36f8da814 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:35.045029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:35.045570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:35.045854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:35.046155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:35.046823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:35.047126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:35.048565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:35.061855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:35.067740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:35.184476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:35.209839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd79480-ba3e-4320-a161-b60ecfca25ad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:35.244006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:35.244627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:35.244905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:35.245178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] PATH_INFO: `/v3/users/4ed15b04d368497596a002c395575a09` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:35.246326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed15b04d368497596a002c395575a09)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:35.247776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:35.249327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:35 2022] GET /identity/v3/users/4ed15b04d368497596a002c395575a09 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:35.255067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:35.302577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:35.358471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91a0c-e837-489f-b45d-02a8b6da6c53 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:35.398922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:35.399564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:35.399849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:35.400120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:35.492723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:35.494822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:35.557329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:35.630048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:35.635633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:35.775798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea264-5dbc-43df-94be-b040ff05efa9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:35.822423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:35.822988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:35.823271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:35.823544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:35.824685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:35.826140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0da58a-b45c-447d-ad98-ea70f7ac8141 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:35.828055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:35 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:35.833681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:36.002103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f077-fc02-41f0-ae2c-78b62bc9ba45 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:36.050757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:36.051379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.051663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.051937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.052673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91, user.id=4ed15b04d368497596a002c395575a09) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:36.052980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:36.054444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6872c5d-33f2-46fe-bc46-1b989e01d5b0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:36.064532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:35 2022] GET /identity/v3/role_assignments?user.id=4ed15b04d368497596a002c395575a09&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:36.586325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036152c-df28-472d-84c8-ef7c845c85f6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.587527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036152c-df28-472d-84c8-ef7c845c85f6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.588023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036152c-df28-472d-84c8-ef7c845c85f6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.589586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:36.595210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e66e-0cdd-4872-94fe-b23d7c593376 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.595747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e66e-0cdd-4872-94fe-b23d7c593376 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.596226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e66e-0cdd-4872-94fe-b23d7c593376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.615576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6cc4e66e-0cdd-4872-94fe-b23d7c593376 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:36.617121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6cc4e66e-0cdd-4872-94fe-b23d7c593376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:36.619479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:36.659361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd410c-b46f-47e3-a53f-216bde056008 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.659882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd410c-b46f-47e3-a53f-216bde056008 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.659882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd410c-b46f-47e3-a53f-216bde056008 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.661231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 106/210] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:36.667005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c7b99-9be0-4121-af0d-380ace0e2b96 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.668339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c7b99-9be0-4121-af0d-380ace0e2b96 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.668619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c7b99-9be0-4121-af0d-380ace0e2b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.690547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-da3c7b99-9be0-4121-af0d-380ace0e2b96 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:36.692056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-da3c7b99-9be0-4121-af0d-380ace0e2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:36.700702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 105/211] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:36.704371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:36.762898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:36.902478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ba00-aa34-49f9-8482-c69313df646c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.902980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ba00-aa34-49f9-8482-c69313df646c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.902980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ba00-aa34-49f9-8482-c69313df646c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.904516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 106/213] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:36.909807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:36.910122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:36.910394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:36.929693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:36.930949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:36.988353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ba00-aa34-49f9-8482-c69313df646c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.006906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 108/214] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:37.044490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.110661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ba00-aa34-49f9-8482-c69313df646c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.135602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.148893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.149559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.149843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.150154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.157483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.162930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:37.164117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7d19-030b-4c62-b9e6-50439eb9b8cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-924c4222-de3a-488b-b840-eacc0c33aea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:37.173921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:37.174894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:37.175677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:37.176287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:37.178805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b7f78-df80-4bcd-a04a-0b4f48167e7c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.179300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b7f78-df80-4bcd-a04a-0b4f48167e7c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.179890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b7f78-df80-4bcd-a04a-0b4f48167e7c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.182747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 108/216] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:37.184250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b7f78-df80-4bcd-a04a-0b4f48167e7c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.206259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.206894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.207173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.207446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.218423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-aa5c958b-769d-4e1b-8681-f7a3dc748952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:37.223470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:37.224423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:37.225224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:37.230904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.231192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.231468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.250354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:37.251598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:37.316662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b7f78-df80-4bcd-a04a-0b4f48167e7c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.331171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 110/218] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:37.332017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.361057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.362226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.362501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.362787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.363868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:37.364177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.365717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.374694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 109/219] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:37.375332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.428319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.445514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.471265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986091-d253-4ff2-952d-24f06d7939b6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.493202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4812-0161-49c0-ae0b-74df0969fdd9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.506319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.507238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.507699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.508147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.509535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:37.510054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.511621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.523109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 111/220] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:37.529393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.530370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.530995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.531277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.531552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.532647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.534109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.535673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 110/221] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:37.536423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.643639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c1624-04b1-4e57-98ae-354a17931409 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.647633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744bc78-a423-48c8-b5a1-4b9cac8704da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.669545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.674773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.677570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.678233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.678568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.678798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.679914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.681381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.682977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 111/222] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:37.683079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.683696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.683791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.684053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.684242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] PATH_INFO: `/v3/users/76ffcd45cd1948ef8a39e87d545f1a16` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.698076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] RBAC: Authorizing `identity:get_user(user_id=76ffcd45cd1948ef8a39e87d545f1a16)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.699519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.705674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 112/223] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/users/76ffcd45cd1948ef8a39e87d545f1a16 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:37.705674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.790225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577759-02ec-4906-bf71-e46fb955be86 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.817636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77ec89-c4f6-411c-b0c3-25a6f1b4bbb7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.824078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.824692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.824977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.825254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.825912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:37.827403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:37.848987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 112/224] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:37 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:37.849806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.853697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:37.854408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:37.854678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:37.854958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:37.870993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:37.876116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:37.877093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:37.877863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:37.879157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:37.925765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.937302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:37.985716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940fdfe-9ddc-4844-80f0-0d07dc2e937f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:37.999300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3829f51-c566-4a2b-ad91-9496debfb267 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.028380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.029146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.029427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.029705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.030943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.032344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.034160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:38.034882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.042384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.043010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.043290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.044161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.122252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.123962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.157383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e385a-166e-4cd1-9d00-bc1443d35ba2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.189379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:38.189870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:38.205731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.206506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.206658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.206935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.207602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:38.207907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.209281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.222535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:38.224096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.261634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 114/228] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:38.262989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.349081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a08938-688b-4e1e-8985-c971dd7727ad None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.386053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2241-641f-4de3-ab4a-81936723f264 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.387887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.388659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.389703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.389703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/users/4bb0f41ea64449f9ac8342dbadf93aec/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.391612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, user_id=4bb0f41ea64449f9ac8342dbadf93aec, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.393244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.409284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 115/229] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:38 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/users/4bb0f41ea64449f9ac8342dbadf93aec/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:38.410177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.429035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.429920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.430371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.431504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.433050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.434707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.436799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:38 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:38.444663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.470842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:38.481561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:38.549348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-b54b-4cd3-b588-1f17f0494038 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.590335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.591150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.591543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.592181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.593521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.595841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.597733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:38 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:38.605992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.729853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe46f92-6ba0-43b3-bc67-d7cf55dde3d2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.741556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:38.744174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6de69a-fa45-44e3-b178-b5032904a8a0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.770455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.771733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.772166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.772862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.773738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=76ffcd45cd1948ef8a39e87d545f1a16) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:38.774837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.776574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.783022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 117/232] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:38 2022] GET /identity/v3/role_assignments?user.id=76ffcd45cd1948ef8a39e87d545f1a16&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:38.806288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.807261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.807684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.808156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.809565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.811231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8dbd-e975-4e80-a085-fbffde48e3c3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:38.813339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 116/233] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:38 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:38.819633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:38.943260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a70a-ae60-426b-b125-24d676236cb5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:38.983268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:38.984190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:38.984628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:38.985059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/users/4bb0f41ea64449f9ac8342dbadf93aec/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:38.987465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, user_id=4bb0f41ea64449f9ac8342dbadf93aec, role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:38.989170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63354cf8-c409-4fd7-aefd-9d9572111b73 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:39.008678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:38 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/users/4bb0f41ea64449f9ac8342dbadf93aec/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:40.608793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728180b3-b4a1-439d-9c32-2a19b9e5cb8d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:40.609294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728180b3-b4a1-439d-9c32-2a19b9e5cb8d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:40.609294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728180b3-b4a1-439d-9c32-2a19b9e5cb8d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:40.610753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 117/235] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:40.616191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:40.616585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:40.616767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:40.636485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:40.637661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:40.676507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:40.721519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe0ea-3a70-43f5-b300-f64cd8a7317d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:40.721832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe0ea-3a70-43f5-b300-f64cd8a7317d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:40.722100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fe0ea-3a70-43f5-b300-f64cd8a7317d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:40.723713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 118/236] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:40.730034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfe04-1551-4d96-87d6-22a558070f1d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:40.730321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfe04-1551-4d96-87d6-22a558070f1d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:40.730594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfe04-1551-4d96-87d6-22a558070f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:40.734020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:40.762909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-528bfe04-1551-4d96-87d6-22a558070f1d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:40.764091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-528bfe04-1551-4d96-87d6-22a558070f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:40.849889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:41.015075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.142441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7aad-a4cf-48de-b611-f117c4bcfa34 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.144003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55439-6b8b-4238-9219-6206a8092170 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.144334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55439-6b8b-4238-9219-6206a8092170 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.144610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55439-6b8b-4238-9219-6206a8092170 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.146083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 120/239] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:41.151948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.152236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.152511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.184066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:41.186766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:41.193374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:41.194374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.194929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.195395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.197602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:41.204868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:41.205036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:41.210087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 120/240] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:41.217055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.271367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:41.311494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 121/241] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:41.312357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.397242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce5cf-72be-4bcd-8e70-9b29e97f7462 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.470686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:41.471307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.471592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.471869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.474243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:41.475688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:41.485081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7219f-d3bc-4856-b06f-6fb08ada4a72 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.520543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 121/242] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:41 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:41.563003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:41.563664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.563952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.564227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.583284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:41.589097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:41.590096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:41.590903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 122/243] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:41.597970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.619546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.623152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:41.744631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:41.759386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465adc-86fc-4770-97fb-27a452caa3ed None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.773151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361029e4-cf56-4cf1-ba2d-64060c3195b1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.797091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:41.797707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.798022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.798296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.798960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:41.799262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:41.800633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7603f-3ab4-471a-a963-4871c92a3e46 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:41.811489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:41.812222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bca09-a623-450d-9db8-9cad95fc67c4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.812222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bca09-a623-450d-9db8-9cad95fc67c4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.812423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bca09-a623-450d-9db8-9cad95fc67c4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.813865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 123/245] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:41.814748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c4fb-ab1c-4f90-9f18-195cd45643eb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.815031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c4fb-ab1c-4f90-9f18-195cd45643eb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.815389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c4fb-ab1c-4f90-9f18-195cd45643eb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.816952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 124/246] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:41.817684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8c4fb-ab1c-4f90-9f18-195cd45643eb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:41.818637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18353337-a111-4332-8971-121a7b15af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:41.819522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353337-a111-4332-8971-121a7b15af97 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.820214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353337-a111-4332-8971-121a7b15af97 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.820719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353337-a111-4332-8971-121a7b15af97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.833411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18353337-a111-4332-8971-121a7b15af97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-18353337-a111-4332-8971-121a7b15af97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:41.840024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:41.840869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:41.841738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:41.843330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 123/247] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:41.849179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c009-8a8f-480a-8906-8836835c8dbe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.849179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c009-8a8f-480a-8906-8836835c8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.849179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58c009-8a8f-480a-8906-8836835c8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.865122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6c58c009-8a8f-480a-8906-8836835c8dbe None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:41.866425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c58c009-8a8f-480a-8906-8836835c8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:41.939773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:41.947268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8c4fb-ab1c-4f90-9f18-195cd45643eb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:41.953188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 124/248] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:41.955246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:41.955246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:41.955246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:41.990667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:41.991863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:42.015492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.016131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.016413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.016688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] PATH_INFO: `/v3/users/a9ff8736100842969f544c2cc6d03d97` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.043401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] RBAC: Authorizing `identity:get_user(user_id=a9ff8736100842969f544c2cc6d03d97)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.044874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.048882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:41 2022] GET /identity/v3/users/a9ff8736100842969f544c2cc6d03d97 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:42.049681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.073615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.128594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 125/250] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:42.129280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.272688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e44-f79b-4337-ac71-7657a6a14871 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.300709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8dd16-3419-41b5-a425-4f3078ae7404 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.342172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.342761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.343043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.343319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.343983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:42.344286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.346252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.349999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.363399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 126/251] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:42.364242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.371632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.372315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.372598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.372873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.500565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.500977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.502586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.540198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645c71-82f4-432d-a8ea-514a24bee7b0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.577809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.578160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.578248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.578502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.589694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:42.595579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:42.596434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 127/252] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:42.601882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.618315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 126/253] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:42.619494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.647074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.731150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a84b26-b2ab-4723-9c8a-856cbead0f57 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.732402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405065b7-3000-4077-87bd-5aa024218f5f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.772777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.774082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.774754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.775116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.775388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.782004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.783224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.783834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.784567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.786736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.788564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:42.789055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.791525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 128/254] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:42.792668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:42.794243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:42.795115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:42.796375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:42.800658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 127/255] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:42.802226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.913368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:42.915718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59798752-db14-4c19-a661-93a34dfbd534 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.937012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd53-0da4-4c22-8b2c-f952be994333 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:42.956696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.957877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.958716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.959187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.960034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:42.960545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.962947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.973455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 129/256] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:42.978833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:42.989509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:42.990555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:42.991033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:42.991594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:42.993472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:42.995276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:42.997189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 128/257] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:42.998365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.045587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.088044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c897b-f428-4428-99d8-9a0f333825e1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.111511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ac55-0838-4e85-b593-8c85fa35b283 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.122707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.123322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.123656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.123941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.151168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.152247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.152849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.153313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.154231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:43.154735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.156561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.166393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 129/258] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:43.167559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.184232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.199774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.201309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.260344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.283968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992bf97-2b67-4132-99d5-8d52bf923ce9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.314545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 130/259] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:43.315526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.322961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.323979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.324483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.324956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] PATH_INFO: `/v3/users/4bb0f41ea64449f9ac8342dbadf93aec` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.326393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] RBAC: Authorizing `identity:get_user(user_id=4bb0f41ea64449f9ac8342dbadf93aec)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.328126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.330030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 130/260] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/users/4bb0f41ea64449f9ac8342dbadf93aec => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:43.331129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.420701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e4d01-a796-4c8d-9819-e16834197b85 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.422823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.445343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e310-ce51-4f84-83db-434da3a2f50f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.455879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.456807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.456807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.457080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.457812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=a9ff8736100842969f544c2cc6d03d97) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:43.458173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.459635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.465803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 131/261] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/role_assignments?user.id=a9ff8736100842969f544c2cc6d03d97&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:43.474946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.487401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.488505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.488979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.489443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] PATH_INFO: `/v3/users/76ffcd45cd1948ef8a39e87d545f1a16` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.491195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] RBAC: Authorizing `identity:get_user(user_id=76ffcd45cd1948ef8a39e87d545f1a16)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.493010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.494995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/users/76ffcd45cd1948ef8a39e87d545f1a16 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:43.496180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.547249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.617063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729629aa-0e3c-494a-8a68-3eba28b4f9e0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.656942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.657607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.657815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.658882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.678089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.750301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047afe22-0206-4827-b648-c15c4c59bff1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:43.774884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.776348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54daf9e-4f0a-4cd1-977a-22fbf9d877d5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.820283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:43.823703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:43.824056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:43.824338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:43.826462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:43.830397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:43.834016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 132/263] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:43.834970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:43.952154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:43.963943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d57-f1ca-43b7-a231-1369d979224a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:44.006737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:44.007738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.008223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.009281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.011575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:44.014338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:44.016306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 133/264] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:44.016927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:44.020835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 132/265] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:44.022688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98ab6-63b6-471d-8539-8f199ba5592f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.024220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98ab6-63b6-471d-8539-8f199ba5592f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.024698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98ab6-63b6-471d-8539-8f199ba5592f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.026412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 133/266] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:44.027412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98ab6-63b6-471d-8539-8f199ba5592f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:44.102141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:44.140637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01364-8ac2-4416-be1b-12556f08fa2a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:44.164536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98ab6-63b6-471d-8539-8f199ba5592f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:44.179182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:44.179764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.180046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.180878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.181614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=4bb0f41ea64449f9ac8342dbadf93aec) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:44.181927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:44.183383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:44.189301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 134/267] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:44 2022] GET /identity/v3/role_assignments?user.id=4bb0f41ea64449f9ac8342dbadf93aec&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:44.190037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:44.217501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:44.218866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.219966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:44.220356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.221813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/users/76ffcd45cd1948ef8a39e87d545f1a16/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.225536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, user_id=76ffcd45cd1948ef8a39e87d545f1a16, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:44.229554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cae05a-b9ec-4d32-97e5-ce57d8a5d3ab None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:44.250321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 134/268] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:44 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/users/76ffcd45cd1948ef8a39e87d545f1a16/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:44.252209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343554-c1ef-42f9-b186-acafb8c6313c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.252705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343554-c1ef-42f9-b186-acafb8c6313c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.253425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343554-c1ef-42f9-b186-acafb8c6313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.275231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a343554-c1ef-42f9-b186-acafb8c6313c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:44.276898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a343554-c1ef-42f9-b186-acafb8c6313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:44.375069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 135/269] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:44.377086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a27e-41ef-40c7-ba2b-c58bd731bfdd None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.377602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a27e-41ef-40c7-ba2b-c58bd731bfdd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.378476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98a27e-41ef-40c7-ba2b-c58bd731bfdd None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.380825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 136/270] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:44.388575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.389014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a73a7-7015-4c44-a834-1b9e89c413c9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:44.389444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.389907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.416923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:44.419551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:44.432428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:44.432811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.433052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.433324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.434546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:44.436282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:44.438175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 135/271] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:44 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:44.443988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:44.465366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:44.568232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 137/272] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:44.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:44.582893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2246-46b1-4efe-8297-2514100f5129 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:44.630148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:44.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:44.631044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:44.631326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:44.632055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=4bb0f41ea64449f9ac8342dbadf93aec) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:44.632362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:44.633827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:44.642349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 136/273] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:44 2022] GET /identity/v3/role_assignments?user.id=4bb0f41ea64449f9ac8342dbadf93aec&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:44.872612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:44.906554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:45.007862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c7c17-f762-49b3-8162-e1ca2b13e157 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.048678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.049404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.049687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.049982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.051727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:45.053244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:45.054681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa6a3e-dd0c-49b4-bbcc-49e5c445f930 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.055783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 138/274] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:45.063223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:45.107565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.108210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.108493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.108773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.121064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:45.124295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:45.130098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:45.130967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:45.131832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:45.134528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:45.139865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:45.159203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:45.205103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94c7a-191c-4067-8ed7-aa4118f083b3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.247904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.248884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.249358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.249820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.250725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:45.252623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:45.258364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5ee4-2f83-48d6-b095-63811dd52f94 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.284736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 139/276] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:28:45 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:45.297720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.298597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.298886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.299157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.299945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:45.300254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:45.301888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:45.313806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:45.319693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:45.433288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:45.444845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c561-fd1d-4c4a-b6dc-1d13d092eb73 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.484003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.484657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.484943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.485219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] PATH_INFO: `/v3/users/535fad1c638841d797a6a35637110009` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.501171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] RBAC: Authorizing `identity:get_user(user_id=535fad1c638841d797a6a35637110009)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:45.502678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09baccd-dfd7-4f4a-aa0a-0880b74253f4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:45.504989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:45 2022] GET /identity/v3/users/535fad1c638841d797a6a35637110009 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:45.511504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:45.602404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:45.627016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda10ff-1ed1-48d5-bfd7-00dbb2b5e850 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:45.666164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:45.666787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.667072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.667348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.668086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, user.id=535fad1c638841d797a6a35637110009, scope.system=all) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:45.668431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:45.669842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f3ac-cb04-4394-836d-114e248235e6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:45.676549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 139/279] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 8 18:28:45 2022] GET /identity/v3/role_assignments?user.id=535fad1c638841d797a6a35637110009&scope.system=all&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:45.907229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f6a0-a81b-4368-a041-6e27049045ed None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.907709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f6a0-a81b-4368-a041-6e27049045ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.907783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f6a0-a81b-4368-a041-6e27049045ed None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.909243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 141/280] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:45.915031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f86e-a855-468d-b992-28499b6035ab None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:45.915439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f86e-a855-468d-b992-28499b6035ab None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:45.915607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f86e-a855-468d-b992-28499b6035ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:45.936816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4646f86e-a855-468d-b992-28499b6035ab None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:45.938014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4646f86e-a855-468d-b992-28499b6035ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:46.038433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 140/281] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:46.323831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51f6a0-a81b-4368-a041-6e27049045ed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:46.460023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51f6a0-a81b-4368-a041-6e27049045ed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:46.515204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:46.515845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:46.516127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:46.516394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:46.528265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:46.533329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:46.534223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:46.535023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:46.538059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 142/282] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:46.541011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646f86e-a855-468d-b992-28499b6035ab None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:46.638773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:46.677992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646f86e-a855-468d-b992-28499b6035ab None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:46.726417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:46.727078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:46.727357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:46.727625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:46.728292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:46.728588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:46.729973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfbaf6-77f0-4cb1-9dad-cf8d6d4169b0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:46.739013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:46.747113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:46.763969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:46.815603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283a7a-48a1-4d04-af3a-c59dcb741907 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:46.815906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283a7a-48a1-4d04-af3a-c59dcb741907 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:46.816074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283a7a-48a1-4d04-af3a-c59dcb741907 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:46.817667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 142/284] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:46.823332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:46.823611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:46.823881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:46.856349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:46.857594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:46.900787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f07c-a630-4af3-ac28-71bb01232430 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:46.948279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:46.948931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:46.949161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:46.949432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] PATH_INFO: `/v3/users/a9ff8736100842969f544c2cc6d03d97` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:46.950590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] RBAC: Authorizing `identity:get_user(user_id=a9ff8736100842969f544c2cc6d03d97)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:46.952835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:46.955173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 143/285] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:46 2022] GET /identity/v3/users/a9ff8736100842969f544c2cc6d03d97 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:46.960504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:46.990481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 143/286] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:47.054410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:47.077877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eae244-d2d2-4cb3-a036-76277d3068c8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:47.113178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:47.113894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:47.114206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:47.114475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:47.115595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:47.117089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:47.118762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:46 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:47.124768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:47.219676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:47.264686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c1d2-f52e-405d-b6fc-d0f8144c2165 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:47.310040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:47.310704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:47.310983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:47.311257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/users/a9ff8736100842969f544c2cc6d03d97/roles/65dc35ec47ad472d836746df55c57bb5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:47.313168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, user_id=a9ff8736100842969f544c2cc6d03d97, role_id=65dc35ec47ad472d836746df55c57bb5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:47.314775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:47.338160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:28:47 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/users/a9ff8736100842969f544c2cc6d03d97/roles/65dc35ec47ad472d836746df55c57bb5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:47.426444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:47.553799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8c333-8674-4b2f-9ac8-ba8704ac6472 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:47.592062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:47.592606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:47.592886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:47.593201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:47.604641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:47.609398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:47.610289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:47.611150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:47.616382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:47.725540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1d9fa-8ea0-42f0-aca9-26757cc91130 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:47.750834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:47.770030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:47.774636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:47.775140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:47.775622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:47.776518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:47.777045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:47.778628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:47.787615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:47.793491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:47.807546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:47.944848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161cbc-0677-4791-b602-ef438b27e3b3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:47.986746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:47.987579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:47.987757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:47.987992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] PATH_INFO: `/v3/users/76ffcd45cd1948ef8a39e87d545f1a16` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:47.989181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] RBAC: Authorizing `identity:get_user(user_id=76ffcd45cd1948ef8a39e87d545f1a16)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:47.990862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9ff5-d073-47cc-a3c9-4de807afc208 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:47.993456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:47 2022] GET /identity/v3/users/76ffcd45cd1948ef8a39e87d545f1a16 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:47.998617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:48.122339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6e8ee-660c-4492-b2b4-6fcb02b3a93a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:48.160953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:48.161817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.162276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.162697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.232586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:48.252479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:48.254226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:48.272131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd21-92ca-450b-a574-3c7459cc6654 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.272417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd21-92ca-450b-a574-3c7459cc6654 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.272693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738fd21-92ca-450b-a574-3c7459cc6654 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.274464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 147/292] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:48.284470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb885ff-a1e6-497b-ab99-a700c78aa3a8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.285045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb885ff-a1e6-497b-ab99-a700c78aa3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.285526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb885ff-a1e6-497b-ab99-a700c78aa3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.327364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-adb885ff-a1e6-497b-ab99-a700c78aa3a8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:48.329013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-adb885ff-a1e6-497b-ab99-a700c78aa3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:48.373545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 146/293] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:48.383011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:48.463108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 148/294] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:48.469964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bc35-6bf1-4f08-be57-69a1fc0b85e3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.470790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bc35-6bf1-4f08-be57-69a1fc0b85e3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.471272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485bc35-6bf1-4f08-be57-69a1fc0b85e3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.473122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 149/295] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:48.479060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:48.479365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb936f5-9b8f-461b-81c4-66bdf8bd2515 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.479850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb936f5-9b8f-461b-81c4-66bdf8bd2515 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.480392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb936f5-9b8f-461b-81c4-66bdf8bd2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.491497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:48.494230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161e413-79d8-4f2f-9c77-7f574894c9d4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:48.511949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9fb936f5-9b8f-461b-81c4-66bdf8bd2515 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:48.513328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fb936f5-9b8f-461b-81c4-66bdf8bd2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:48.542080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:48.543136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.543618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.544089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.546602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:48.549890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:48.552300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 147/296] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:48 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:48.560374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:48.618580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 150/297] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:48.619624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72569-e6a5-4cad-88f7-cca54a0eadb4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.619920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72569-e6a5-4cad-88f7-cca54a0eadb4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.620194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72569-e6a5-4cad-88f7-cca54a0eadb4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.621553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 151/298] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:48.626874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.627167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.627449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.647223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:48.649236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:48.673644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c8c2-76d8-4e56-b8e5-f06e2ffb0ba1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:48.710100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:48.711178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.712160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.712626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.713633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=76ffcd45cd1948ef8a39e87d545f1a16) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:48.714299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:48.715951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:48.721968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 152/299] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:48.722964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 148/300] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:48 2022] GET /identity/v3/role_assignments?user.id=76ffcd45cd1948ef8a39e87d545f1a16&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:48.775344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:48.864826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:48.912073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5873-132e-4d94-a9b4-02e3c972fc0a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:48.951287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:48.966264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:48.966912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:48.967192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:48.967461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:48.969698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:48.971173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:48.972944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 153/301] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:48.977281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:48.978247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.098815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac868-1eda-40df-bfc6-0c4e2dcba37b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.110383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b67758-6360-4bf0-b3b3-b511e87fc420 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.137535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.138022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.138270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.138546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.149382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:49.153442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:49.154805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:49.155714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 149/302] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:49.157146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.158764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.159615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.160339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.161713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] PATH_INFO: `/v3/groups` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.161713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.163461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.180934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 154/303] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Sep 8 18:28:48 2022] POST /identity/v3/groups => generated 229 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:28:49.182194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.261439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:49.296382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cf5b-1828-494b-a2c9-3b0ae5ddb19d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.328727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc70fb-fadd-4d70-ad2c-1e099ebafb94 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.334904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.335785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.336769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.337204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.349322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:49.356747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:49.357621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:49.359705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 150/304] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:49.370894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.372600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.373277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.373560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.373829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.374528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:49.374829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.376192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.387428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 155/305] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:49.394319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.464568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:49.500590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886a7b-5065-47e5-b66c-f123bf32cedd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.515906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026d87-a0ac-42bd-be99-668da958eb6c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.540040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.540948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.541666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.542135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.543498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:49.544077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.545851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.553065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:49.557567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.558459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.558880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.559293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] PATH_INFO: `/v3/users/535fad1c638841d797a6a35637110009` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.560488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 151/306] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:49.560753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] RBAC: Authorizing `identity:get_user(user_id=535fad1c638841d797a6a35637110009)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.562359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.568624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.568806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 156/307] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/users/535fad1c638841d797a6a35637110009 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:49.569753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.675224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e966b-54e7-4594-bfeb-0f1dc5b3daaf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.700089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:49.707642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b8d93-baa5-46a5-bb77-339c473f4c12 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.714829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.715696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.716123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.716545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] PATH_INFO: `/v3/system/users/535fad1c638841d797a6a35637110009/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.718237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=535fad1c638841d797a6a35637110009, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.719941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.738497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 157/308] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Sep 8 18:28:49 2022] PUT /identity/v3/system/users/535fad1c638841d797a6a35637110009/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:49.747607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.748268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.748553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.748833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] PATH_INFO: `/v3/users/4e2700431644478e9c413f4e02e00803` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.765474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] RBAC: Authorizing `identity:get_user(user_id=4e2700431644478e9c413f4e02e00803)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.767009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fdf68-da9b-4d62-9903-c784d44a1899 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.769130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 152/309] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/users/4e2700431644478e9c413f4e02e00803 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:49.775662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:49.894009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8d381-e541-4045-b446-1505d6bc0520 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:49.933187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:49.933739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:49.934052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:49.934334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:49.935071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, user.id=4e2700431644478e9c413f4e02e00803, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:49.935381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:49.936857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9943e-1eac-4423-ad43-0823e8c5603c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:49.942599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 158/310] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 8 18:28:49 2022] GET /identity/v3/role_assignments?user.id=4e2700431644478e9c413f4e02e00803&scope.system=all&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:50.093206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa463c9-be04-4007-be65-efac3d6e6a79 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:50.093525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa463c9-be04-4007-be65-efac3d6e6a79 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:50.093759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa463c9-be04-4007-be65-efac3d6e6a79 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:50.095422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 153/311] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:50.101093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:50.102337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:50.102837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:50.122460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:50.124433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:50.176075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:50.199496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 159/312] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:50.478062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa463c9-be04-4007-be65-efac3d6e6a79 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:50.540350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:50.584228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa463c9-be04-4007-be65-efac3d6e6a79 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:50.619827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:50.620458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:50.620736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:50.621013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:50.631934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:50.636922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:50.637763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:50.638571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 154/313] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:50.644095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:50.751446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5f5f9-8d57-4ee7-a299-da8c7b22f6f2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:50.785889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:50.786886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:50.787376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:50.787851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:50.788699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:50.789751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:50.791348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:50.799970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 160/314] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:50.805424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:50.917735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184fb2d-62cb-49dd-a738-e5baddf5714c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:50.938299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:50.953137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:50.953772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:50.954084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:50.954358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] PATH_INFO: `/v3/users/a9ff8736100842969f544c2cc6d03d97` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:50.955489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] RBAC: Authorizing `identity:get_user(user_id=a9ff8736100842969f544c2cc6d03d97)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:50.956921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:50.958845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 155/315] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:50 2022] GET /identity/v3/users/a9ff8736100842969f544c2cc6d03d97 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:50.964915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:51.010049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:51.071065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef88a-1fdc-4616-951e-ebd4964ba232 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:51.106424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:51.107035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.107313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.107585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.177506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:51.179008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:51.222221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:51.293466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 161/316] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:51.298834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:51.411781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c72a-3bb7-4608-88ed-dfa9dd2fa918 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:51.449483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:51.450140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.450418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.450692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.451801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:51.453238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d52f9-77e9-4e38-9137-d7e0d328de23 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:51.455183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 156/317] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:51 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:51.461136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:51.520502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e349b-e2f1-4566-90ac-dcbad45cf8a8 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.521006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e349b-e2f1-4566-90ac-dcbad45cf8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.521078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e349b-e2f1-4566-90ac-dcbad45cf8a8 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.522625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 157/318] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:28:51.528991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b936-9955-4507-b4df-b27627631f66 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.529274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b936-9955-4507-b4df-b27627631f66 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.529541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b936-9955-4507-b4df-b27627631f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.550217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b001b936-9955-4507-b4df-b27627631f66 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:51.551334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b001b936-9955-4507-b4df-b27627631f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:51.574324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0a3a-852e-4bd6-bfbf-48a3c7704f4d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:51.608447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:51.619310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:51.619922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.620197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.620466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.621408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, scope.project.id=c5c5794523d04767a06520a5a06be32e, user.id=a9ff8736100842969f544c2cc6d03d97) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:51.621769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:51.624379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:51.634030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 162/320] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:28:51 2022] GET /identity/v3/role_assignments?user.id=a9ff8736100842969f544c2cc6d03d97&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:51.634324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 158/320] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:51.906773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:51.916209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:51.987717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077de0-083b-46f2-8538-29d52bfa0576 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.988006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077de0-083b-46f2-8538-29d52bfa0576 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.988285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077de0-083b-46f2-8538-29d52bfa0576 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:51.989614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 159/321] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:51.995052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf2e9-ca8d-4455-92e1-bb692b946f3f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:51.995350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf2e9-ca8d-4455-92e1-bb692b946f3f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:51.995621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacf2e9-ca8d-4455-92e1-bb692b946f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.014595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9bacf2e9-ca8d-4455-92e1-bb692b946f3f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:52.015801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9bacf2e9-ca8d-4455-92e1-bb692b946f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:52.016746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6add4-c230-4d40-a960-927dbc3b7265 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.052269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.052896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.053180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.053453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.054698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:52.056561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:52.058132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 163/322] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:52.063486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.087135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 160/323] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:28:52.144714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:52.172220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83cb6a-6ca3-41dd-99fa-27ede5b775a1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.208677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.209308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.209570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.209827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] PATH_INFO: `/v3/groups` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.210498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:52.212474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cbda1-178b-420f-8292-a4eaa1a9ec9b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:52.229413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 164/324] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Sep 8 18:28:52 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:28:52.302332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f82e-dbdf-4d65-8937-4882d5dd04b7 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.302692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f82e-dbdf-4d65-8937-4882d5dd04b7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.302904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f82e-dbdf-4d65-8937-4882d5dd04b7 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.304453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 161/325] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:52.310024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.310309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.310591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.330195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:52.331431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:52.360873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f82e-dbdf-4d65-8937-4882d5dd04b7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.409740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 165/326] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:52.468341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f82e-dbdf-4d65-8937-4882d5dd04b7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.487848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:52.513770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.514691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.514968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.515241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.528722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:52.534285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:52.535218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:52.536612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 162/327] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:52.541907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.619102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:52.668709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931bcfe-6b0a-40c5-8349-06e0d5530f9b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.683885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.722293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.723312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.723790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.724755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.725896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:52.726493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:52.728681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:52.738251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 166/328] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:52.743881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.821567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6944fd-68a6-49b7-9c55-72a8a0316de0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.860192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52a41a-797a-4d9c-8ac3-3886d662d54e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:52.861680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.862577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.863058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.863524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.881834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:52.888716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:52.889621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:52.890436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:52.891643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 163/329] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:28:52.897474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.900891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:52.914168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:52.915400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:52.915864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:52.916579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] PATH_INFO: `/v3/users/535fad1c638841d797a6a35637110009` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:52.918508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] RBAC: Authorizing `identity:get_user(user_id=535fad1c638841d797a6a35637110009)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:52.920690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:52.923348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 167/330] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/users/535fad1c638841d797a6a35637110009 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:52.930977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:52.943604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:53.017079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bba6e-6de9-4e45-b468-e087ac791f9f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:53.057855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:53.058600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:53.058972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:53.059512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:53.060097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:53.060511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:53.062162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:53.070058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346c69-3a3e-4b5f-b4ff-2f855a7ca447 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:53.072738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 164/331] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:53.078289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:53.125660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:53.126420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:53.126768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:53.127127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:53.128182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] RBAC: Adding query filter params (role.id=ce5d4a8ed4954d7ba651d5f72aa35249, user.id=535fad1c638841d797a6a35637110009, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:53.128915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:53.130179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:53.147802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 168/332] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 8 18:28:52 2022] GET /identity/v3/role_assignments?user.id=535fad1c638841d797a6a35637110009&scope.system=all&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:53.211283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c335190-5a8c-484a-b171-3e226de10c50 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:53.214102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:53.255823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:53.256492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:53.256776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:53.257052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] PATH_INFO: `/v3/users/4e2700431644478e9c413f4e02e00803` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:53.258362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] RBAC: Authorizing `identity:get_user(user_id=4e2700431644478e9c413f4e02e00803)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:53.259856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbb6d1-eac7-4dfe-929e-6cf856c44d7f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:53.261969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 165/333] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:53 2022] GET /identity/v3/users/4e2700431644478e9c413f4e02e00803 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:53.272844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:53.360725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:53.416127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04643f6-b7b0-4f93-98eb-950a9cb3f2e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:53.460180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:53.461144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:53.461565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:53.462005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] PATH_INFO: `/v3/system/users/4e2700431644478e9c413f4e02e00803/roles/65dc35ec47ad472d836746df55c57bb5` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:53.463575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e2700431644478e9c413f4e02e00803, role_id=65dc35ec47ad472d836746df55c57bb5)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:53.465084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16240f-6c96-439b-a2de-9d98d73e81a9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:53.478239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 169/334] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Sep 8 18:28:53 2022] PUT /identity/v3/system/users/4e2700431644478e9c413f4e02e00803/roles/65dc35ec47ad472d836746df55c57bb5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:28:54.710100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7513-ac09-443e-972c-8d91cfa06963 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:54.710606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7513-ac09-443e-972c-8d91cfa06963 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:54.710747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7513-ac09-443e-972c-8d91cfa06963 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:54.712876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 166/335] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:54.719303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62c3-e2d2-46d1-8194-1768c23565bc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:54.720149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62c3-e2d2-46d1-8194-1768c23565bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:54.720621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62c3-e2d2-46d1-8194-1768c23565bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:54.742984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6cbd62c3-e2d2-46d1-8194-1768c23565bc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:54.744494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6cbd62c3-e2d2-46d1-8194-1768c23565bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:54.828768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 170/336] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:55.253114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b23d-def7-4602-878a-4683e2aa3d96 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.253796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b23d-def7-4602-878a-4683e2aa3d96 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.254326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b23d-def7-4602-878a-4683e2aa3d96 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.256112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 167/337] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:55.261229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.261808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.262358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.298921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:55.300421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:55.360178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:55.396533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 171/338] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:55.402401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2b23d-def7-4602-878a-4683e2aa3d96 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:55.537136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2b23d-def7-4602-878a-4683e2aa3d96 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:55.581083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:55.581722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.582024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.582296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.594892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2c682663-59d1-432a-8738-846240e3b4f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:55.600262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:55.601141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:55.602408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 168/339] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:55.607577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:55.701316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd9b5-51a6-4845-b765-93e35aa09284 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.701863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd9b5-51a6-4845-b765-93e35aa09284 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.702495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd9b5-51a6-4845-b765-93e35aa09284 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.704388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 169/340] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:55.709136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.709640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.710146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.744730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:55.746273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:55.778904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6592-0f92-4578-a445-1087e09a68aa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:55.779790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:55.839090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:55.839644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:55.839925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:55.840194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:55.840871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:55.841174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:55.842592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:55.860550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 172/341] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:55.866722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:55.883848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 170/342] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:55.923737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:55.994768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734328a2-0c21-4b2e-a04a-849d21a2c8f7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.045387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.046029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.046318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.046590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.082736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.145884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:56.147437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:56.199028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:56.294424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 173/343] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:56.301170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.333122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b87613-cf3d-4feb-a295-d4d8eaae64d3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.420025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.420686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.420969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.421242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.440343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:56.445375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:56.446257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:56.447016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:56.450988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 171/344] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:56.456541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.477256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb06c-9989-4768-bcdd-3cb1af8d7d21 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.482417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:56.550681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.551575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.552086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.552499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.553842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:56.556054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:56.558163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 174/345] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:56.563281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.572609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:56.608045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bf61f-242d-4c27-b8a1-896cd7295428 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.664976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.665837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.667311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.667757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.669733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:56.670257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:56.671770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:56.688918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 172/346] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:56.690066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.710301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ed5ec-952c-4147-9235-18128fa7de62 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.779435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.780816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.781262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.781683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.795410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:56.797172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:56.800942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 175/347] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:56.802005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.848949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:56.898385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:56.900312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9539-d4ec-4319-9992-a5f79e65109c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.936289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948387-d8a3-461b-a145-2fd7aec2581e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:56.955842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.956484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.956772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.957041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:56.969126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:56.975318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:56.976727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:56.977632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:56.977738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:56.978733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 173/348] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:56.979548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:56.981074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.056271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.058288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701013c-8b47-48c3-be35-ad0f177cdd92 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.098540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c2c2f-2ab5-4fc8-95d4-ea4d1401336c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:57.143768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.144749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:57.145715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.145715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.146121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.147010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:57.147318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.148796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c083ab-cde5-4c44-ba88-add0e54f7450 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.157907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.158183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 174/349] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:57.162820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720e946-a615-4408-93c8-a95d3d66215f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.163251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720e946-a615-4408-93c8-a95d3d66215f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.163537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720e946-a615-4408-93c8-a95d3d66215f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.166283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 175/350] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:57.166920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720e946-a615-4408-93c8-a95d3d66215f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:57.191103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 176/351] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:57.192434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9a55-ce83-4166-856f-a52b5987f991 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.192796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9a55-ce83-4166-856f-a52b5987f991 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.193077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9a55-ce83-4166-856f-a52b5987f991 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.194572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 177/352] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:57.195704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.195982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.196258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.215573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:57.216778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:57.321728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 178/353] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:57.325375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:57.326336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720e946-a615-4408-93c8-a95d3d66215f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:57.382402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:57.384239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.384926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.385350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.386725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:57.387465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.389146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354ecc6-3a5b-454c-a337-cf140afa3b55 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.400488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 176/354] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:57.402192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.402494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.402772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.424903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:57.426413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:57.462043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.472161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6399-ddb6-4b6e-b012-5535fb0b587c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:57.530833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.547745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:57.548928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.549213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.549489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.551247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:57.552535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.554025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.556207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:57 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:57.556488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:57.562396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:57.735276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47302f-381f-4de3-917e-7c4a509c3c2d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:57.737483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000a8b-2137-4986-a764-d0e68b993423 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:57.798541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:57.799984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.800473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.800953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.803019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:57.803019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:57.803313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:57.803534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:57.804943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.806617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.808721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 180/357] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:28:57 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:57.815381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:57.878323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.890702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:57.911158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:57.912682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbf8d-742c-4030-93d6-a69fa68409c6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:57.974160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1b70f-d6b7-43c1-be93-a0c3a4e2e7dd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.030696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.031280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.031566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.032121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.032817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:58.033127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.034772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.041341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 181/358] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:28:57 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:28:58.042300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.043392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 178/359] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:58.044845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987a6c-168d-4089-a3a8-73f5d7ac6903 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.045325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987a6c-168d-4089-a3a8-73f5d7ac6903 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.045809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91987a6c-168d-4089-a3a8-73f5d7ac6903 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.047572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 179/360] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:58.048510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987a6c-168d-4089-a3a8-73f5d7ac6903 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.158373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.161381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460548-88a6-4dbc-8848-db2273a6e992 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.185891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.201193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91987a6c-168d-4089-a3a8-73f5d7ac6903 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.211376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.212096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.213131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.213428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.231150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7ee93372-d033-4064-a9f2-3704a522efb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:58.242095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:58.243886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:28:58.244864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:28:58.247058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 182/361] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:58.248866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.249160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.249432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.262021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.263198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.263680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.264157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.275705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:28:58.276884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:28:58.290725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:58.295595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:58.296486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:58.297290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 180/362] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:58.298025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.357164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 183/363] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:28:58.358050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.456134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb449975-23be-4b52-b101-80e8839c074c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.458436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.472568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5346a0-9bce-442e-9f08-70a385ebd44e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.509550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.510531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.510967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.511387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.512194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:58.512663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.514219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.514532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.514867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.515145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.515415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.516574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.518091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.520688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 181/364] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:58.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.525589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:58.526651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.568300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.653878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9bc85-5c40-4d4f-b5b9-09706c432231 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.722794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228882b-e07b-4dd3-bc75-d58efe28317b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.725452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.726333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.726764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.727181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.730387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.736417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.738649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 185/366] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:58.739639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.769061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.769964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.770415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.770834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.771634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:58.772085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.772522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.776117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.786372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 182/367] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:58.787588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:58.899615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ce2f-9797-4525-ac2c-d8888f29f779 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.911119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:58.935315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a6b35-6d8a-4b5d-93ba-a2fd85999a3d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:58.947027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.948231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.948667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.949089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.980397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:58.981350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:58.981768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:58.982169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:58.983179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=c5c5794523d04767a06520a5a06be32e) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:58.983936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:58.985770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:58.994489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:58.995547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.080745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.082587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.126434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:59.204704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254df523-f1f8-47bf-b2f8-3ab0db9d9cf4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.242545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.243479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.243931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.244399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] PATH_INFO: `/v3/users/4e2700431644478e9c413f4e02e00803` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.245854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] RBAC: Authorizing `identity:get_user(user_id=4e2700431644478e9c413f4e02e00803)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.247497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.249242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 184/369] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/users/4e2700431644478e9c413f4e02e00803 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:59.250201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.286555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:59.367656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b5cca-046f-425b-bb3f-2b5fc452974b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.376777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 186/370] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:28:59.378019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.403612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.404580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.405036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.405494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.417348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:28:59.423113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:28:59.423991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:28:59.424779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:28:59.427259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:28:59.428215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.512263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:59.537469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b093f0-f049-4a84-b7e4-7609d46c16dc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.574317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.575336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.575824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.576304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.577620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.580448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.583315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 186/372] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:59.584380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.629324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6103cab-128e-484a-bf6d-e773d2533789 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.662175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:59.690250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.690884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.691164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.691435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.692187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] RBAC: Adding query filter params (role.id=65dc35ec47ad472d836746df55c57bb5, user.id=4e2700431644478e9c413f4e02e00803, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:59.692532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.694322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.697441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715f16-b7f2-4e51-a4d2-3b937a175247 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.721786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 187/373] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/role_assignments?user.id=4e2700431644478e9c413f4e02e00803&scope.system=all&role.id=65dc35ec47ad472d836746df55c57bb5 => generated 510 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:59.722688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.736412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.737423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.737981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.738462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.739316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:28:59.739823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.741520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.751530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 187/374] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:59.757913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:28:59.765791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:28:59.925070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e394-a593-4696-8cac-a7391d4d28ea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:28:59.970514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:28:59.972241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.972823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.973344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.975006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:28:59.977249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93c14-c723-48b0-834a-282650cd9929 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:28:59.980162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 188/375] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:28:59.981928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a537-7fa1-4415-9517-500d5ecabb53 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.982447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a537-7fa1-4415-9517-500d5ecabb53 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.983269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a537-7fa1-4415-9517-500d5ecabb53 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.984777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 189/376] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:28:59.990457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:28:59.990748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:28:59.991029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:28:59.992755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f0a86-e3b0-4bd7-a635-ae7e1b76a8dd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.019193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:00.020318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:00.049080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:00.049809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:00.050791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:00.051069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:00.072739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.108610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 190/377] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:00.109519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.137268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:00.138748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:00.141511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.243276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 188/378] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:00.249697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.324543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1285d-a940-4b0b-8e8d-240c24fe4e71 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.368130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:00.369315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:00.369961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:00.370443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:00.371363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=c5c5794523d04767a06520a5a06be32e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:00.371908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:00.373535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:00.380780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 191/379] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:00.435916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25dd3f-5407-482a-a80a-5522faf7a240 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.438970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.474103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:00.475126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:00.475621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:00.476674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] PATH_INFO: `/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:00.478256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] RBAC: Authorizing `identity:get_project(project_id=418c9b38e71d4cf1be4f4a5862e811b8)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:00.479949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:00.482118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 189/380] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:00.491163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.502985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.570249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.675021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e35b-37d2-401d-a072-e2beecc97853 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.688561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087787-77d3-4633-b570-5baa62616503 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.732424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:00.733071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:00.733355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:00.733634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] PATH_INFO: `/v3/groups/908d1244ec6f423dbd6b844fdc4045cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:00.742846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] RBAC: Authorizing `identity:get_group(group_id=908d1244ec6f423dbd6b844fdc4045cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:00.744303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:00.752607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 192/381] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/groups/908d1244ec6f423dbd6b844fdc4045cc => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:00.758233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:00.758879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:00.759160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:00.759434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:00.762470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.785668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:00.791165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:00.792027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:00.793209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 190/382] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:00.800042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:00.870020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.955118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b93a9-1ac9-45e3-85e5-3f61e08b5f2c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:00.957555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:00.985311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1021fa-d507-410c-9a6f-ec444bfe4c27 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:01.009572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.010216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.010755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.011028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.012169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] RBAC: Adding query filter params (group.id=908d1244ec6f423dbd6b844fdc4045cc, role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=418c9b38e71d4cf1be4f4a5862e811b8) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:01.012478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:01.013915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee786a-d9a5-49a3-b5a7-412191361c0c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:01.026142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 193/383] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/role_assignments?group.id=908d1244ec6f423dbd6b844fdc4045cc&scope.project.id=418c9b38e71d4cf1be4f4a5862e811b8&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:01.027927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898ffa-74d5-45ba-9aa8-f33ae58075e2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.028216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898ffa-74d5-45ba-9aa8-f33ae58075e2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.028491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898ffa-74d5-45ba-9aa8-f33ae58075e2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.029797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 194/384] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:01.035735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.036198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.036542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.044122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.044760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.045041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.045314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.046018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:01.046391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:01.047879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:01.058405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 191/385] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:29:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:01.058974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:01.060178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:01.067111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:01.188189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 195/386] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:01.233918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:01.243496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622291ff-b543-48b2-9792-401a951f0fe7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:01.295709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.296363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.296642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.296918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.298663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:01.300112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:01.302053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 192/387] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:01 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:01.308268 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:01.411160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:01.415356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f09a2-6739-47a9-830b-970b44772291 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:01.456621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.457180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.457459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.457732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.460586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:01.462053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:01.463684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 196/388] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:01 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:01.469749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:01.592988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0ed3c-3c54-4930-82ed-c3fb109727c3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:01.636164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:01.669486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.670205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.670486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.670759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/groups/196b22737313409f89852c8fe777be3f/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.674346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, group_id=196b22737313409f89852c8fe777be3f, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:01.675838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b923b-f56f-460e-8657-d9b1986692c8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:01.709147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 193/389] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 8 18:29:01 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/groups/196b22737313409f89852c8fe777be3f/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:01.778467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca87f-2e41-4544-9f48-bc66c823f604 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:01.818354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060af38f-1214-4219-b867-93d2a931854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:01.819003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060af38f-1214-4219-b867-93d2a931854b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.819311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060af38f-1214-4219-b867-93d2a931854b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.819613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060af38f-1214-4219-b867-93d2a931854b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.831590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a87e-ee6f-40f6-8ec5-822a9e1fe0c2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.831916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a87e-ee6f-40f6-8ec5-822a9e1fe0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.832142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143a87e-ee6f-40f6-8ec5-822a9e1fe0c2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.833699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 194/390] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:01.834654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060af38f-1214-4219-b867-93d2a931854b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:01.839465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:01.839756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:01.840034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-060af38f-1214-4219-b867-93d2a931854b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:01.840304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:01.841117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:01.842253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 197/391] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:01.848318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060af38f-1214-4219-b867-93d2a931854b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:01.878237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:01.879474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:01.908160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:01.922341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:02.003922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 195/392] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:02.036598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060af38f-1214-4219-b867-93d2a931854b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.073637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.074335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.074618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.074891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.075618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:02.075928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:02.077299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:02.086947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 198/393] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:02.092607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.213111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed5b61-74d0-448f-a482-2992137179c1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.262386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.263560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.264335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.265112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.266535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:02.268188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:02.270132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 196/394] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:02 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:02.289400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.413352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:02.421669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.433260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d06d0-074d-4b19-a356-b48eb6e6d9d3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.448438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:02.481036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.481892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.482073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.482223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.484093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:02.485530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:02.487464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:02 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:02.493006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.547373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc3bb-c372-4a65-9d94-3f1ddbc595b2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.597492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.599074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.599675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.604399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.624362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:02.630764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:02.631827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:02.632840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:02.642454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 197/396] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:02.647242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.696351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44166-6aef-4169-b69c-2830fcc09fa2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.736573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:02.752008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.753565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.754155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.754783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/groups/196b22737313409f89852c8fe777be3f/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.761207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a93185dc0db4fe085bd498cd4c0ea91, group_id=196b22737313409f89852c8fe777be3f, role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:02.762818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:02.763531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3e-3ea8-4b33-8a17-d350322b1468 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:02.791692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 200/397] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 8 18:29:02 2022] PUT /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91/groups/196b22737313409f89852c8fe777be3f/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:02.801669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:02.802587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:02.803025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:02.803437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:02.804791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:02.805235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:02.806806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:02.817154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 198/398] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:02.824949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:02.861089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:02.989757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e665155-4a54-4c18-8594-2ab7a43c5e93 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:03.035391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:03.036035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.036319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.036601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.042819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:03.044323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:03.046440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 201/399] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:02 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:03.052104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:03.176845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81b852-5d19-41be-ae46-c682246c67e1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:03.219090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:03.221881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.222394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.222864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.224469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:03.226675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951e2f-b905-419a-8e13-9926dcaee227 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:03.228935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 199/400] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:03 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:03.234361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:03.351983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:03.368108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51ace-71bf-4fb2-8252-3e069fa3fb04 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:03.416460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:03.417549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.418072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.418543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/groups/196b22737313409f89852c8fe777be3f/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.420814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, group_id=196b22737313409f89852c8fe777be3f, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:03.422603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dcd88-13e4-4564-923b-04783844025b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:03.442137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 202/401] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 8 18:29:03 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/groups/196b22737313409f89852c8fe777be3f/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:29:03.613215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ce1d-733a-4b51-9b76-e9e56557be90 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.613862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ce1d-733a-4b51-9b76-e9e56557be90 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.614381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ce1d-733a-4b51-9b76-e9e56557be90 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.616329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 200/402] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:03.622494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56269-4a3f-46b9-9cb7-4b2ee9bff9c3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.623139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56269-4a3f-46b9-9cb7-4b2ee9bff9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.623610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56269-4a3f-46b9-9cb7-4b2ee9bff9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.648779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5cc56269-4a3f-46b9-9cb7-4b2ee9bff9c3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:03.650428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5cc56269-4a3f-46b9-9cb7-4b2ee9bff9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:03.734416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 203/403] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:03.958017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd77a5-3ae9-4e47-b3d8-623c1eb29c88 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.958652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd77a5-3ae9-4e47-b3d8-623c1eb29c88 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.959123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd77a5-3ae9-4e47-b3d8-623c1eb29c88 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.961036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 201/404] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:03.965846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:03.966432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:03.966907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:03.985791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:03.987290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:04.073834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 204/405] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:04.125797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd77a5-3ae9-4e47-b3d8-623c1eb29c88 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.148344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:04.255746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd77a5-3ae9-4e47-b3d8-623c1eb29c88 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.306950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.307593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.307873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.308146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.324306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:04.329143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:04.330033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:04.330810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 202/406] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:04.337146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.342303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:04.367241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.500216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:04.522042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946453-1f05-43ab-acd4-cc8a7d973b23 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.536131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c0be4-b7d8-4e88-8662-f4e454eac881 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.558305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.559115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.559397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.559663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.560329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:04.560630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:04.562131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd001f86-4e12-4eda-90cd-2b2907e05b25 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:04.571643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 205/407] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:04.572878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71236a0-2d6c-436b-a8fe-d021164c394e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.573164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71236a0-2d6c-436b-a8fe-d021164c394e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.573443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71236a0-2d6c-436b-a8fe-d021164c394e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.578137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.578961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 206/408] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:04.579077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.579377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.579652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.580007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.580290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.580557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.592502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:04.598721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:04.599590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:04.600395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:04.601024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:04.601095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:04.601095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.601295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:04.666898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:04.682576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 207/410] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:04.683185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.713783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2fd13-bf51-471a-9233-9501546c22c8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.745822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:04.751847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.752974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.753416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.754028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.755454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:04.757083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:04.763924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 204/411] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:04.765229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.876249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a18e77-29a4-4cba-9954-f1148c29f8db None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.877623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588c3d2-ae2f-462f-889d-2c10be254e0c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:04.915656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.916521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.916944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.917358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.918733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:04.920356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:04.926387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:04.928414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:04.959566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:04.960701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:04.960988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:04.961259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:04.961924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:04.962248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:04.963614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:04.981426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 208/413] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:04.987651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.018307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.078487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b344c-83f3-41f0-aa98-88805a45e135 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.088565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.120756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.121812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.122317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.122792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e/groups/196b22737313409f89852c8fe777be3f/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.125620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c5794523d04767a06520a5a06be32e, group_id=196b22737313409f89852c8fe777be3f, role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.127619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.143168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f3038-ec6a-4498-bda1-9d9e861e3baa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.146662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 206/414] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 8 18:29:04 2022] PUT /identity/v3/projects/c5c5794523d04767a06520a5a06be32e/groups/196b22737313409f89852c8fe777be3f/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:29:05.147761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.210136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.210946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.211318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.211683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] PATH_INFO: `/v3/groups/908d1244ec6f423dbd6b844fdc4045cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.216522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] RBAC: Authorizing `identity:get_group(group_id=908d1244ec6f423dbd6b844fdc4045cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.218195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.220577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 209/415] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:04 2022] GET /identity/v3/groups/908d1244ec6f423dbd6b844fdc4045cc => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:05.238092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.272217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372136-67e5-4fea-b888-315c73ce2bdb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.303694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.315177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.316156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.316640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.317113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.331857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:05.338519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:05.339454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:05.340237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:05.343392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 207/416] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:05.355063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.451376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db0a0e-2446-4a0b-a716-525a37252f7b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.478722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.490060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.490575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.490859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.492970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] PATH_INFO: `/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.494197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] RBAC: Authorizing `identity:get_project(project_id=418c9b38e71d4cf1be4f4a5862e811b8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.495617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.500502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 210/417] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:05 2022] GET /identity/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:05.504459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.507808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbf27-c0fe-420a-b08a-6763c8f49fab None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.546083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.547058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.547559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.548033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.548889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:05.549418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.551015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.560621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 208/418] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:05.567945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:05.636330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d07dd1-e622-49b5-8660-3ed78bf65e2f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.642320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.681257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.682458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.682890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.683309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] PATH_INFO: `/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8/groups/908d1244ec6f423dbd6b844fdc4045cc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.686156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=418c9b38e71d4cf1be4f4a5862e811b8, group_id=908d1244ec6f423dbd6b844fdc4045cc, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.688202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cab293-930d-43a7-8954-6d30275ed5c4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.694487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14c17-24cf-498a-aa9e-168d8211562c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:05.705821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 211/419] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 8 18:29:05 2022] PUT /identity/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8/groups/908d1244ec6f423dbd6b844fdc4045cc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:29:05.707289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961cfb-1830-4038-b6e4-3735450f82ea None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.707769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961cfb-1830-4038-b6e4-3735450f82ea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.708209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961cfb-1830-4038-b6e4-3735450f82ea None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.710523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 212/420] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:05.718041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc35bf-e00f-44f8-89cb-e596524ce807 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.718041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc35bf-e00f-44f8-89cb-e596524ce807 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.718041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc35bf-e00f-44f8-89cb-e596524ce807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.740774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70dc35bf-e00f-44f8-89cb-e596524ce807 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:05.742570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70dc35bf-e00f-44f8-89cb-e596524ce807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:05.785836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:05.787494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:05.787779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:05.788056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:05.884439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:05.907540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:05.909126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:05.932557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 213/421] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:05.973199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:06.017715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158061c-eb2c-4c0c-a195-20b69dcfcca5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.018060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158061c-eb2c-4c0c-a195-20b69dcfcca5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.018344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158061c-eb2c-4c0c-a195-20b69dcfcca5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.019913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 214/422] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:06.026134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.026423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.026705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.035999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 209/423] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:06.048088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.073614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:06.077330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:06.219659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd7df-9150-47aa-b8ae-62ab97feb1de None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.220230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 215/424] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:06.221126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.286490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.287128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.287407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.287677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.293182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:06.294660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:06.296293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 210/425] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:06.303403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.330038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:06.406998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156fb5a-0cb2-44ef-8bc4-f1139fc086f1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.422606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:06.466197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.466837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.467120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.467393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.483920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397cca-dfd5-40da-bff0-722db116b64b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.486661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:06.496625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:06.497511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:06.498319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:06.500322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 216/426] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:06.501650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.532849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.533657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.533884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.534212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.535395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:06.537089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:06.539725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 211/427] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:06.540623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.623084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22b258-0923-44ef-9985-5dd75e4da513 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.650291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:06.661067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.661700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.662016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.662293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.670573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb15-4629-498e-8b97-55acb41aee15 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.673655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:06.678633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:06.680021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 18:29:06.680794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:06.685117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 217/428] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:06.686061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.715082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.716170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.716610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.717432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.718583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:06.719006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:06.720459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:06.728982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:06.737664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 212/429] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:06.737664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.806429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17142d6-b9f3-4009-a341-2d1701b9f725 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.843975 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.844936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.845482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.845899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.846863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:06.847313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:06.849120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:06.855014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206206-2426-4cf2-a5bb-e39ffa9a9169 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:06.856127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 218/430] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:06.857350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.907881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:06.908889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:06.909440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:06.909964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:06.910917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:06.911443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:06.913564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:06.939707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 213/431] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:06.947911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:06.967594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.064639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab3ab-7e52-437a-901b-59311170f309 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.098313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.112187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.113160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.114400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.114972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.121175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9672-20bc-4e28-bc85-9cbfb5cc027e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.157119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.157735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.158044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.158320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.193914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.197648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.232642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.234988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.244329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.308343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.314272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 219/432] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:07.322018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.362371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 214/433] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:29:07.372339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.441217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb036252-bbdd-48ee-a9cb-1961d46626c5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.480175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.481175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.481655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.482223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] PATH_INFO: `/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.484100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] RBAC: Authorizing `identity:get_project(project_id=2a93185dc0db4fe085bd498cd4c0ea91)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.485692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eeccd-0aa7-4e3d-89b4-86056b767235 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.485987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.488311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 220/434] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/projects/2a93185dc0db4fe085bd498cd4c0ea91 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:07.495157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.495429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.526480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.527437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.527887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.528330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.529652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.531297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.533093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 215/435] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:07.539969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.592929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.645794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0d757-f1b1-46f0-a6a8-d9ef9b959387 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.673611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5dd2e-473a-4b05-949a-1425caf485cb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.691623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.692782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.693627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.694125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.695971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.697580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.700377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 221/436] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:07.706583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.722794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.723946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.724288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.724749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.726412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.728160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.730728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 216/437] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:07.737252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:07.785860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.846438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb403-c2eb-4567-94bb-1dc64ff55d08 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.860616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7514-56f7-4279-a172-e99d6f6442a1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:07.887590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.888200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.888487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.888767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.889540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:07.889835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.891333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ee88-19ab-4a83-8769-a29286d668f2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.893100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:07.904465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:07.904465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.904465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.904465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.904869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ce5d4a8ed4954d7ba651d5f72aa35249, scope.project.id=c5c5794523d04767a06520a5a06be32e) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:07.904869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:07.904869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee2452-c59b-4e15-8b34-ad8e894ccae3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:07.906800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 222/438] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=2a93185dc0db4fe085bd498cd4c0ea91&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:07.907576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17edc1-71d4-4d86-b737-e469c92d6187 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.907933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17edc1-71d4-4d86-b737-e469c92d6187 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.908116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17edc1-71d4-4d86-b737-e469c92d6187 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.917971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 223/439] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:07.918174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 217/440] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:07 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ce5d4a8ed4954d7ba651d5f72aa35249 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:07.918254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94807-5b0a-4069-ac42-d61c28b55f9b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:07.918254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94807-5b0a-4069-ac42-d61c28b55f9b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:07.918254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94807-5b0a-4069-ac42-d61c28b55f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:07.937805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5ee94807-5b0a-4069-ac42-d61c28b55f9b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:07.939088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5ee94807-5b0a-4069-ac42-d61c28b55f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:08.026099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 224/441] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:08.228645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b9e0-a6e9-41f3-8cd7-54c3e92517c6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.228996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b9e0-a6e9-41f3-8cd7-54c3e92517c6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.229208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b9e0-a6e9-41f3-8cd7-54c3e92517c6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.230722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 218/442] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:08.235780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.236065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.236338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.256327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:08.258061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:08.289990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b9e0-a6e9-41f3-8cd7-54c3e92517c6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.336751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 225/443] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:08.400250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b9e0-a6e9-41f3-8cd7-54c3e92517c6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:08.409582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:08.436047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:08.436677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.436956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.437228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.447970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:08.453224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:08.454161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:08.454994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 219/444] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:08.460662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.519345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:08.559796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de47f9a-2b57-4795-b8fa-8f5e55e29028 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:08.592789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:08.593382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.593662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.593935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.594617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:08.594918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:08.596272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:08.603916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 226/445] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:08.605199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.609337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.703858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015e4-b0b8-4662-8923-4177be32ca84 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:08.708668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb676ece-d4f8-4fb3-bef8-b314b1fc3eb3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:08.727728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:08.736577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:08.737200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.737482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.737760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.742619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:08.743207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.743485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.743753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.748503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:08.753516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:08.754420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:08.755190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 220/446] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:08.760871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.788104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:08.812090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:08.813569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:08.859084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df899f0-cfa6-41d4-828d-d2f4aaadfefc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:08.892076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:08.892676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:08.892958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:08.893228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:08.893879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:08.894210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:08.895575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:08.903302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 221/447] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:08.908855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.915098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 227/448] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:29:08.916117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:08.937933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:08.998579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:09.008002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795034e3-38b1-4485-9015-9446f0203cbb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.014852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456a71e-11b1-4e3f-8794-d8aaa6c312dd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.040085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.040614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.040892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.041161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.048276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.048887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.049172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.049448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] PATH_INFO: `/v3/projects/c5c5794523d04767a06520a5a06be32e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.050560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c5794523d04767a06520a5a06be32e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.052005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.053648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 228/449] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/projects/c5c5794523d04767a06520a5a06be32e => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:09.059500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:09.106360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.107811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.144952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:09.157289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20359957-df74-4baf-bde9-3f5220e68f98 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.190430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.191043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.191321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.191591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] PATH_INFO: `/v3/groups/196b22737313409f89852c8fe777be3f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.192685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] RBAC: Authorizing `identity:get_group(group_id=196b22737313409f89852c8fe777be3f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.193530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:09.194632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.201148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 229/450] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:09 2022] GET /identity/v3/groups/196b22737313409f89852c8fe777be3f => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:09.202090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:09.210754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 222/451] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 18:29:09.216097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:09.302564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3533679-5df8-494b-9b45-4e9687c94999 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.314590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348d7a-9363-4ac0-8b0e-3e28f2c51af5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.340141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.340789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.341012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.341282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.342033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] RBAC: Adding query filter params (group.id=196b22737313409f89852c8fe777be3f, role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=c5c5794523d04767a06520a5a06be32e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:09.342342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.343764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.349317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 230/452] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:09 2022] GET /identity/v3/role_assignments?group.id=196b22737313409f89852c8fe777be3f&scope.project.id=c5c5794523d04767a06520a5a06be32e&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:09.353134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.353768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.354078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.354350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] PATH_INFO: `/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.355528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] RBAC: Authorizing `identity:get_project(project_id=418c9b38e71d4cf1be4f4a5862e811b8)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.356993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.358717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 223/453] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:29:09 2022] GET /identity/v3/projects/418c9b38e71d4cf1be4f4a5862e811b8 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:09.364515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:09.389444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:09.471362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ea760-07c6-43e3-8607-d8e39ce2b3b3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.506350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.507585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.507858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.508131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] PATH_INFO: `/v3/groups/908d1244ec6f423dbd6b844fdc4045cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.509236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] RBAC: Authorizing `identity:get_group(group_id=908d1244ec6f423dbd6b844fdc4045cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.510826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782dff2-45a1-4bf4-9fb4-bf8bd98206d5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.512390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 231/454] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 8 18:29:09 2022] GET /identity/v3/groups/908d1244ec6f423dbd6b844fdc4045cc => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:09.518465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:09.582467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:09.623525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8154b52-1c9b-43d6-bb84-d62c0dc1d074 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:09.657133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:09.657752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:09.658056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:09.658336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:09.659060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] RBAC: Adding query filter params (group.id=908d1244ec6f423dbd6b844fdc4045cc, role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=418c9b38e71d4cf1be4f4a5862e811b8) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:09.659525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:09.662339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1232c-2d60-4f85-b72f-3efabbdf16e4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:09.671945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 224/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 8 18:29:09 2022] GET /identity/v3/role_assignments?group.id=908d1244ec6f423dbd6b844fdc4045cc&scope.project.id=418c9b38e71d4cf1be4f4a5862e811b8&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:12.223938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d30fb-ee48-4535-80a3-60ad068f7eae None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.224955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d30fb-ee48-4535-80a3-60ad068f7eae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.226008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d30fb-ee48-4535-80a3-60ad068f7eae None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.227838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 232/456] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:12.233374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea452c-00b2-474e-9df7-21fd3016fa7e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.234224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea452c-00b2-474e-9df7-21fd3016fa7e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.234695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea452c-00b2-474e-9df7-21fd3016fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.258311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-39ea452c-00b2-474e-9df7-21fd3016fa7e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:12.259908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-39ea452c-00b2-474e-9df7-21fd3016fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:12.344559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 225/457] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:12.470175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa22f-c4a4-4646-ad61-e34c2806e730 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.470493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa22f-c4a4-4646-ad61-e34c2806e730 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.470725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa22f-c4a4-4646-ad61-e34c2806e730 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.472280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 233/458] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:12.477970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1dce-0b56-4b13-b39e-d5052f6d5b90 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.478502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1dce-0b56-4b13-b39e-d5052f6d5b90 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.478972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1dce-0b56-4b13-b39e-d5052f6d5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.497674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6e1c1dce-0b56-4b13-b39e-d5052f6d5b90 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:12.503534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e1c1dce-0b56-4b13-b39e-d5052f6d5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:12.556658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:12.587108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 226/459] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:12.783320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445664-6a65-4121-b6b6-c03ad331185e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.783919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445664-6a65-4121-b6b6-c03ad331185e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.784411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445664-6a65-4121-b6b6-c03ad331185e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.786197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 234/460] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:12.791640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445664-6a65-4121-b6b6-c03ad331185e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:12.796189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:12.796700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:12.802349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:12.828745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:12.829928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:12.935880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 227/461] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:12.936863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:12.939629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:12.999596 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445664-6a65-4121-b6b6-c03ad331185e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.071619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47fa3f-bcf3-455a-9468-50bdb2b12d17 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.073017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.073887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.074391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.074880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.086757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.087511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.088753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c231cd69-6e21-4dfa-8fb8-8e2699b05f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:13.105064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:13.105988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:13.106833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:13.106833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.106833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:13.108833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 235/462] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:13.110227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496378-eedf-4fe2-b245-7ec23289998d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.110716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496378-eedf-4fe2-b245-7ec23289998d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.111176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496378-eedf-4fe2-b245-7ec23289998d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.112643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 236/463] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:13.114539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496378-eedf-4fe2-b245-7ec23289998d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.118215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.119808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.120101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.120376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.133268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.135028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-03ada1e6-aa34-40ed-bd7b-a608c80c31d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:13.154330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:13.155203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:13.156013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:13.156013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.156013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:13.156013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 228/464] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:13.157854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.158176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.158450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.180732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:13.182211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:13.227048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496378-eedf-4fe2-b245-7ec23289998d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.264196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.265716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.266504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.267167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.268023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:13.268586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.270035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.272585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 229/465] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:13.273863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.284050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.290314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 237/466] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:13.291470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.388130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.396524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b2486-b5a4-4844-9d71-ce40ac81a652 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.402232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3257c-fb59-4ff9-9d9d-5dfa2f82f95c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.436577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.437972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.437972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.437972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.438369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:13.438713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.440086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.452142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.453508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.454049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.454515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.460822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 230/467] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:13.461788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.470700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.472226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:13.495438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:13.496405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:13.497233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:13.497233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.497233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:13.499554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 238/468] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:13.500573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.563592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.589280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48dfbb-512f-47b0-8078-52c59f87ce41 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.624435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb3df-2724-4096-af1b-4be6aac44d59 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.624644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.625181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.625463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.625738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.626412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.628628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.649885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 231/469] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:13 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:13.650684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.664822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.665702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.666212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.666630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.667457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.669303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.673561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.694673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 239/470] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:13 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:13.695868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.882193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56628c-a852-4605-8f0e-b9005099326d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.893374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:13.913681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba848f-f667-4d36-a04e-289143ecd928 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:13.923828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.924561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.924849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.925128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.936955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.938475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2f78ddc7-7ac3-4220-ae99-f39dad8d31ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:13.955520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:13.956468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:13.957477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:13.957477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:13.957477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:13.957477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 240/471] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:13.958211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8b96-c092-4314-9d61-fc2804d8cb97 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.960678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8b96-c092-4314-9d61-fc2804d8cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.960678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8b96-c092-4314-9d61-fc2804d8cb97 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.960870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:13.960870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.960870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.960870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:13.961138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:13.961457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:13.961704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 241/472] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:13.964024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f62c5f-ca97-40f4-a812-4be569f62c17 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:13.964954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8b96-c092-4314-9d61-fc2804d8cb97 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:13.979209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 232/473] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:13.981470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:13.981763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:13.982096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.006194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:14.008019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:14.085706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:14.088826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8b96-c092-4314-9d61-fc2804d8cb97 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.091321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 233/474] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:14.092379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:14.154362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.154974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.155262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.155537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.156298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:14.156592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:14.157991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:14.181737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 242/475] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:14.187300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:14.196743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603dee2-53e3-437a-a92e-0216b3f41867 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.231710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.232697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.233122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:14.233578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.234008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.234794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:14.236382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:14.260872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 234/476] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:14 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:14.327840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417730-3bfd-4b62-8c87-34f1cd5c3e49 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.370576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.371193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.371476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.371752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.372423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:14.373862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:14.399783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 243/477] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:14 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:14.410972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:14.475830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:14.543969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578f334-6158-4257-b918-98749d796ff9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.601396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.602071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.602357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.602634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.603326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:14.604726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:14.613850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.sql.core [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 18:29:14.613850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 18:29:14.613850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [parameters: {'id': 'c5b014f45bb94ef2918f48b0f8640fd0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 18:29:14.613850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81721) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Sep 08 18:29:14.631294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:29:14.632257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application yield resource Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise self.value Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application session.commit() Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 18:29:14.633860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.flush() Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application compat.raise_( Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 18:29:14.634802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:29:14.635677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:29:14.636470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [parameters: {'id': 'c5b014f45bb94ef2918f48b0f8640fd0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:14.637395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 18:29:14.638270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:14.639109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 235/478] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 8 18:29:14 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:14.640251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:14.724528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:14.751888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8166107-cf45-456b-b1ed-0d1223dfc9a6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.794744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.795389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.795676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.795954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.807724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7bb6a0b3-58a6-4530-9ef1-62f7dfd07dd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:14.813026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:14.813899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 18:29:14.814748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:14.815360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 244/479] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:14.825342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:14.947640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab7ef-aa2d-477f-b888-722d8673ec7d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:14.973970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:14.993834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:14.995056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:14.995544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:14.995998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:14.996850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:14.997330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:14.998911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bb8de-2784-4634-92ac-bf5b3fae8422 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:15.009017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 236/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:16.272724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cff83-56a5-4b5c-85a0-f1f042e5d083 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:16.273230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cff83-56a5-4b5c-85a0-f1f042e5d083 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:16.273305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cff83-56a5-4b5c-85a0-f1f042e5d083 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:16.274892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 245/481] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:16.285878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098048df-5439-49d9-a5a5-8bd0640d9eb8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:16.286713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098048df-5439-49d9-a5a5-8bd0640d9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:16.287191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098048df-5439-49d9-a5a5-8bd0640d9eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:16.306070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-098048df-5439-49d9-a5a5-8bd0640d9eb8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:16.307565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-098048df-5439-49d9-a5a5-8bd0640d9eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:16.378075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 237/482] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:16.639007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8c07-d8fd-4964-be4e-afd879ecaaf7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:16.639671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8c07-d8fd-4964-be4e-afd879ecaaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:16.640149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be8c07-d8fd-4964-be4e-afd879ecaaf7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:16.641798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 246/483] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:16.647024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190bcb-6beb-4816-8004-313339775f94 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:16.647537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190bcb-6beb-4816-8004-313339775f94 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:16.648010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190bcb-6beb-4816-8004-313339775f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:16.679516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-75190bcb-6beb-4816-8004-313339775f94 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:16.681087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-75190bcb-6beb-4816-8004-313339775f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:16.755753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8c07-d8fd-4964-be4e-afd879ecaaf7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:16.777361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 238/484] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:16.878584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be8c07-d8fd-4964-be4e-afd879ecaaf7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:16.913884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:16.914874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:16.915356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:16.915839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:16.918954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:16.929323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:16.935185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:16.936153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:16.936957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:16.939879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 247/485] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:16.946600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75190bcb-6beb-4816-8004-313339775f94 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.028838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.080400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.097342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75190bcb-6beb-4816-8004-313339775f94 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.146402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.147682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.147990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.148267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.148957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:17.149569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.151216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25ff44-2833-46e4-95fd-0db8fefa96dd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.162383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 239/486] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:17.164600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2abd-624a-408b-80f5-eb8553d3a262 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.165091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2abd-624a-408b-80f5-eb8553d3a262 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.165564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2abd-624a-408b-80f5-eb8553d3a262 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.167270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 240/487] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:17.168255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d2abd-624a-408b-80f5-eb8553d3a262 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.206184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5546-932f-47cc-a015-c49d9ec43507 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.247439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.248093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.248377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.248653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.265374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a61f5f84-9875-4a12-8eab-95fb0048cf22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:17.272445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:17.273821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:17.274641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:17.276761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 248/488] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:17.278017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.280927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.280927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.304480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:17.305687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:17.310381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d2abd-624a-408b-80f5-eb8553d3a262 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.314702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.362430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.363904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.364674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.365172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.371754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.379073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.380709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.391571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 249/489] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:17.392582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6fe783ba-d0e5-47d1-8c5b-ab98c3b7e312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:17.395115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:17.395984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:17.396868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:17.396868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:17.396868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:17.396868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 241/490] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:17.401915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799ecc-1594-4dff-881e-5c229c7556c9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.402384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799ecc-1594-4dff-881e-5c229c7556c9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.402804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799ecc-1594-4dff-881e-5c229c7556c9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.408397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 242/491] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:17.409323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12799ecc-1594-4dff-881e-5c229c7556c9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.517925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12799ecc-1594-4dff-881e-5c229c7556c9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.520330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c162-8cd2-4143-a547-39a05be0abcb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.558084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.559217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.559967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.560731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.561606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:17.562125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.563718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.564390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.565078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.565428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.565788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.566764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:17.567156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.569137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b07df-0430-4a58-8fef-c1cefd77d3b5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.582368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 250/492] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:17.582823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 243/493] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:17.587320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259c-4a3e-4f52-904a-670646386649 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.588352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.589031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259c-4a3e-4f52-904a-670646386649 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.589743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259c-4a3e-4f52-904a-670646386649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.608876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.609273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9394259c-4a3e-4f52-904a-670646386649 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:17.610859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9394259c-4a3e-4f52-904a-670646386649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:17.664913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.698233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 251/494] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:17.699328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394259c-4a3e-4f52-904a-670646386649 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.717873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cd66a-bf29-48c7-8c10-15c84de09bc1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.759877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.760834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.761130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.761814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.776157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.778467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:17.797193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:17.798119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:17.798957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:17.798957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:17.798957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:17.798957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 244/495] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:17.799821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.818038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394259c-4a3e-4f52-904a-670646386649 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.866518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.867399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.868097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.868380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.878423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:17.879175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.881800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:17.901784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:17.902905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:17.903862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 252/496] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:17.904434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:17.920301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850ed0-54a0-488f-abfa-60d2b0128d86 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:17.973120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:17.979899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:17.980874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:17.981691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:17.982695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:17.997854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:18.005616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:18.007121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:18.007934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:18.010191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 245/497] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:18.011166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.046080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8e05e-f757-4857-8f04-ab9065ef48af None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.078824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.079433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.079711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.079984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.080635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:18.080937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.082352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.094279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 253/498] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:18.095065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.111284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084084a-c8ca-4c14-9da8-3079da2c080b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.137299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.145695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.146335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.146621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.147419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.148143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:18.148456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.149879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.187356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.187968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 246/499] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:18.188828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.191229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd1d64-7d75-4907-b2d5-3b1ee243e7fe None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.226112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.226729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.227004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.227271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.237001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cc76cbeb-4b66-4388-8b3e-231fa77f6072 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:18.241738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:18.242648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:18.243427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 254/500] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:18.244261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c97b68-ca1a-460e-8008-22fa4f966b2e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.244261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c97b68-ca1a-460e-8008-22fa4f966b2e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.244474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c97b68-ca1a-460e-8008-22fa4f966b2e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.245648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 255/501] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:18.250337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c97b68-ca1a-460e-8008-22fa4f966b2e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.314710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e0c3-77c5-44ac-ae6c-0bd3192465f1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.349151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.349759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.350661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.350946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.351608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:18.351912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.353280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.357318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c97b68-ca1a-460e-8008-22fa4f966b2e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.360837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 247/502] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:18.362818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.390364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.390979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.391262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.391531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.398810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.400231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.410691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:18.411556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:18.414091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 256/503] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:18.415235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.434061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.461296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aab22-6c85-43b5-a3a6-9210475ec007 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.493521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.494154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.494439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.494714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.513565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf6a7-9bb9-4824-b91a-e41f0d59dda5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.546783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.547375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.547651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.547922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.548574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:18.548869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.550261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c378-b08a-4b76-b9f5-4f6752b44f44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.559002 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 257/504] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:18.563681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.563681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.563681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.563991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.563991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.578888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:18.580006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:18.613329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.655525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 258/505] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:18.656369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.668102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.677907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 248/506] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:18.678801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.770839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792363-c51e-4442-adac-10d7cba6efa4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.786647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dc3a2-0479-4a7a-a0a8-fb266ed02ca8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.805292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.805921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.806241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.806508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.816695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.818140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.825016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.826053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.826337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.826609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.827724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:18.828193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:18.829712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:18.832974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:18.833857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:18.840279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:18.840279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:18.840279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:18.840279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 259/507] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:18.840279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.851888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 249/508] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:18.852705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:18.862285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.914225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:18.954087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e102561-a841-414c-bcfd-d57ec43414fa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.957491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437ddcb-052e-4d3f-b800-6052614a37d4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:18.989321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.990005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.990297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.990598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:18.992122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:18.992750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:18.993029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:18.993306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.002339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.003319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.003786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.004756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:19.018367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.019231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:19.020083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:19.020083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.020083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:19.020248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.021029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:19.022514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:19.022514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.022514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:19.022670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 260/509] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.022670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.025355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 250/510] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.026229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.081367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.122697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eba44-e3e6-4cb6-9320-c8e98c62fcec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.123623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc156-57c7-49a4-a462-4b228fc13a26 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.137084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.157150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.157333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.157753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.157848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.158054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.158160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.158324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.158411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.158956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:19.159257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.160611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.172033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 261/511] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:19.172827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.226642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.228103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.275140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df590-570b-4bcc-bbae-5f948c6529e6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.283985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.310516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.311142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.311422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.311691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.322053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.323488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.326428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 251/512] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:19.327265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:19.338397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.339391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:19.340239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:19.340239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.340239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:19.340239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 262/513] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.340239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.367081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.432276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9417fc-9889-4d65-9b8b-a80083cbd320 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.438847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047161-687f-4d15-b841-6080b7ef4907 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.466179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.466778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.467060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.467330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.467964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:19.468269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.469624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.472121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.472720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.472999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.473270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.473903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:19.474239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.475587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.480910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 252/514] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:19.481690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.491432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 263/515] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:19.491432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.500579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.574375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.581935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70a5-5921-4892-9010-e6bea36ec922 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.590324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb12ad-d639-4e00-8c83-7d37fc2700ba None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.614942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.615563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.615842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.616112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.623258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.623534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.624153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.624433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.624682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.624770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.635447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.636868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:19.637896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.638840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 253/516] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.639884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:19.654188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.655200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:19.656033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:19.656033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:19.656033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:19.656033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 264/517] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.656033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.720340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.741664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fead88b-cc8d-4e81-b2ed-f0e5545daf53 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.753036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b461-af07-4e49-964e-b2b3c3937a4c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.774895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.775517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.775795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.776067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.776690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:19.776989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.778381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.786214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.786828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.787111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.787411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.789516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 254/518] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:19.790321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.794988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.796530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.798374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:19.809025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.810064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:19.810967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 265/519] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.811511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.889461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621de1c-0bd2-45d2-881e-e8a5586f6ff8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.913347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84020-66a6-4574-8120-148a54d55c27 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:19.921772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.922422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.922699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.922968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.929827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.931281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.932936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:19.943678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:19.945195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 255/520] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:19.946279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:19.953329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:19.953965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:19.954247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:19.954520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:19.955256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:19.955564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:19.957031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:19.993136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 266/521] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:19.993960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.042105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7fa3b-04c9-430f-8b16-d4316a0802e1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.049118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.074215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.074805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.075088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.075361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.076013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:20.076315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.077664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.089574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 256/522] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:20.090375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.091984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a75-4b13-4a68-be62-b023fdaaa357 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.126613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.127469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.127748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.128019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.128665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.130127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.148135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.151832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 267/523] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:19 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:20.152456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.202729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951160c-1d5b-4067-9f2f-c0c0b4db8c4f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.241958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.242588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.242869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.243146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.243895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:20.244208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.245704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.266418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 257/524] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:20.266885 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cdebe-1596-480c-8b7b-771bfcea32d0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.267293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.286346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.314521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.315677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.315965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.316244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.316962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:20.317632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.320298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.342171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 268/525] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:20.343202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.384427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f72d7-898f-4dab-a9cc-38a822112938 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.402421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.421333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.421974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.422258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.422533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.450998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81633a1-9b8c-4a08-9b3a-6ae2a509a974 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.487443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.488078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.488365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.488760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.492278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.493750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.495692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.497276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:20.510502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:20.511551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 269/526] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:20.512404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.546238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.611047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 258/527] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:20.611047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.624353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7b95-3dc8-4709-a4d3-f463b69008cf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.631895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.660696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.661234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.661517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.661794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.727101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c0e9-1cff-4ec6-a16d-40d8ad7383f3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.736391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.738174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.761594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.762231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.762521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.762797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.763525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:20.763835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.765255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.769885 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.771043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 259/528] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:20.772399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.866574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:20.878892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 270/529] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:20.880085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:20.890600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c7ab-5ba8-4e80-b09c-32c997b7b4e6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:20.930339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:20.931450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:20.931884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:20.932360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:20.933219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:20.933761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:20.935581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:20.956168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 260/530] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:20.957342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.022461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b154-6a3a-433f-966c-9feb05c202ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.056507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.064424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.065433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.066655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.067178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.082347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063826-0a00-4d47-925b-47fb75922f2f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.083627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.086807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:21.107639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:21.108609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:21.109473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:21.109473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:21.109473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:21.109473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 271/531] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:21.110140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.125690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.126812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.127544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.128020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.137892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.140849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.142579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:21.159987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:21.160915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:21.161746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:21.161746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:21.161746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:21.166191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 261/532] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:21.167072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.223664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb790-e06d-47c1-8c6b-fc176b523b39 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.259181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.259786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.260067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.260340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.261070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=6fc5a9468ff5431e972345db08ac876d) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:21.261379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.262861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.271073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 272/533] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/role_assignments?user.id=6fc5a9468ff5431e972345db08ac876d&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:21.272696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.285647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ddb78-c205-41e2-a339-4243df21c637 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.326855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.327867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.328407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.328864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.329692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:21.330212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.330875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.333212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.353358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 262/534] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:21.361991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.395806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5b6c8-6b5c-4c94-be8d-28a29d568445 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.469023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.469681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.469917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.470214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.470878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:21.471190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.472608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.479837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.498180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 273/535] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:21.504882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.552804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae335bd-5368-4f58-be49-35db0ea4ccbd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.601537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.602380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.602670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.602949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.615616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.617067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:21.629885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:21.630763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:21.631629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 263/536] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:21.638863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.640358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1628f8-fbad-42ef-8d99-a3341fe05a35 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.650764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.698213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.699290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.699761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.700223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.714424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.716171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:21.733923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:21.734782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:21.735618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 274/537] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:21.746874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.805685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5497-566e-4c20-bde7-48cd405b9ef4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.832425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:21.887422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a0c5-47b8-42b2-9271-b9e7dd83dd17 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:21.891859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.892485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.892771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.893052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.893751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:21.894098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.895532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.925980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 264/538] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:21.930273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:21.941673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:21.942329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:21.942607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:21.942880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:21.943615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:21.943925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:21.945371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:21.963025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 275/539] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:21.969436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:22.023560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:22.132136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc03c1b-dc97-4b54-8a26-75e6d5a25eb6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:22.170989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:22.171883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:22.172312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:22.172730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:22.174615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=2e694edc3a35429b8a2041261f9459e3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:22.175746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:22.177588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87c295-a79a-431e-b3a5-4c06fa141a3f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:22.179635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575cc41-6f64-436d-a29a-fd77d9a3a8d4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:22.192664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/role_assignments?user.id=2e694edc3a35429b8a2041261f9459e3&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:22.241701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:22.242589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:22.243041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:22.243457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:22.244336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=5cef70055b3f49ed9a1aabd221877bdc) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:22.244787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:22.246405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce5c-f2ad-494e-8ddf-465f882811ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:22.258940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 276/541] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:21 2022] GET /identity/v3/role_assignments?user.id=5cef70055b3f49ed9a1aabd221877bdc&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:22.520593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7739-d37d-49ee-82ae-a719f6407733 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:22.521160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7739-d37d-49ee-82ae-a719f6407733 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:22.521403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7739-d37d-49ee-82ae-a719f6407733 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:22.523864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 266/542] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:22.529811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:22.530348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:22.530420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:22.555502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:22.556656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:22.628257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 277/543] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:22.951664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7739-d37d-49ee-82ae-a719f6407733 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:22.997575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:23.089473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7739-d37d-49ee-82ae-a719f6407733 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:23.130154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:23.130783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.131108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.131375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.152199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d699c320-734e-4d96-80f7-0832ed68960e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:23.157355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:23.158321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:23.159135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:23.160243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 267/544] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:23.166936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:23.206449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:23.270775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b80f-6f03-4896-bf0a-42ea92fd3e24 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.271130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b80f-6f03-4896-bf0a-42ea92fd3e24 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.271314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b80f-6f03-4896-bf0a-42ea92fd3e24 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.273545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 268/545] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:23.280679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.280679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.280679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.312982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:23.314197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:23.324970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b09cb6-d807-4688-b8c6-37dfb17859bd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:23.381476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:23.383394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.388060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.388607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.389534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:23.390247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:23.391873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:23.402573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 278/546] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:23.408528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:23.448688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 269/547] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:23.536227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:23.552457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd87af-4de5-4d6b-8845-3d5bf87d95a4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:23.593798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:23.598567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.598861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.599193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.609857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:23.611341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:23.633553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:23.634565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:23.635999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:23.635999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:23.635999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:23.635999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 279/548] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:23.640350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:23.671089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:23.746584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d96c7-3e5a-4aa1-a43a-57aea2e8af2f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:23.781418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:23.782052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.782376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.782655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.783292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:23.783591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:23.784951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:23.796832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 270/549] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:23.803669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:23.887488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:23.954618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f085-7643-49f3-8fd2-a71936f265df None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:23.991947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:23.992570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:23.992853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:23.993130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:23.996185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.008022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.009782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.012272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-61044f66-c1aa-4de7-a305-b8f49bcea282 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:24.024264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:24.025746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:24.027051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:24.028353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47fba6-1bc7-4418-9c8b-32d289a8b923 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.029621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 280/550] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:24.031134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ec9a-598d-47e1-a2aa-52181b4d3685 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.031625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ec9a-598d-47e1-a2aa-52181b4d3685 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.032099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ec9a-598d-47e1-a2aa-52181b4d3685 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.033889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 281/551] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:24.034817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8ec9a-598d-47e1-a2aa-52181b4d3685 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.072000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.073149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.074439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.074956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.087281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d70fde21-5991-4590-8eb7-1d51b736cd23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:24.093370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:24.094319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:24.095304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:24.096898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 271/552] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:24.096898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.096898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.097095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.119256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:24.120444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:24.149734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8ec9a-598d-47e1-a2aa-52181b4d3685 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.192717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.193612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.193893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.194190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.194921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:24.195464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.197566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.204425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 272/553] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:24.205624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.219393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 282/554] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:24.229000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.292566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.320197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671835b-c452-4d6b-8b04-fc5d238a8f5c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.329398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.357640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.358519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.358966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.359376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.360183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:24.360754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.362409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.371534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 273/555] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:24.382920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.422799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45d36-9cb1-43d4-9f0e-3c2b4375cd84 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.504062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.506981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.508327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.509961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.567043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242ecae-7c69-4496-8957-fb5614ff5eaf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.607948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.609070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.610086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.610716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.611730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.613200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.619364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.624031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.625827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:24.644010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:24.645410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:24.646312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:24.646312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:24.646312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:24.653523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 274/556] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:24.654731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.674396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.731750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 283/557] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:24.732692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.779696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5c9-3d83-4b88-8755-4a3f980d463d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.825840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.826514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.826798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.827078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.837864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:24.843163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:24.844588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 275/558] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:24.846079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.861427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd88f-0163-4e5b-bc3d-3166995a86d3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:24.898845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:24.899456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.899747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.900019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.900679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:24.900981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:24.901784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.902828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5149468-3bea-4a1b-abc7-9545f95412b6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:24.916880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 284/559] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:24.918323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb53b-f144-4deb-8954-5e9db235700b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:24.918618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb53b-f144-4deb-8954-5e9db235700b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:24.918892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddb53b-f144-4deb-8954-5e9db235700b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:24.920411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 285/560] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:24.921065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddb53b-f144-4deb-8954-5e9db235700b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:24.942156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:24.967124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e284e-280d-4e8a-95f1-2d37873db610 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.005868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.006527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.006813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.007082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.019593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.021035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.036770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddb53b-f144-4deb-8954-5e9db235700b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:25.039038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.039938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:25.040811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:25.040811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.040811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:25.040811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 276/561] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.041072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.073637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.074272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.074565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.074834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.075488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:25.076021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.077126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d792cb-37fe-44b5-90c9-f8fdef0314e0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.085225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 286/562] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:25.086395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b6f6-5e96-4030-a9f6-bb5ba231a6a5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.086664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b6f6-5e96-4030-a9f6-bb5ba231a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.086936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b6f6-5e96-4030-a9f6-bb5ba231a6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.104319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7e70b6f6-5e96-4030-a9f6-bb5ba231a6a5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:25.105494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e70b6f6-5e96-4030-a9f6-bb5ba231a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:25.143292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e3e83-384c-416e-adf9-65fd80786f10 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.144722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.177396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 287/563] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:25.178761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038989c7-3656-436c-a4ae-9ab4a2e51cc6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.179050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038989c7-3656-436c-a4ae-9ab4a2e51cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.179326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038989c7-3656-436c-a4ae-9ab4a2e51cc6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.180581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 288/564] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:25.181280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038989c7-3656-436c-a4ae-9ab4a2e51cc6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.193901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.194574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.195235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.195512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.195916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.208118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.210115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:25.222882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.223816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 277/565] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.225266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.306505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038989c7-3656-436c-a4ae-9ab4a2e51cc6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.333728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae4a01-21e8-48cb-a62b-91c580195afd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.341451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.342086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.342365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.342632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.343387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:25.343685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.345164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03ca6b-ab07-42ea-85a1-dedf0a3a792e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.362480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 289/566] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:25.364020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.364308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.364680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.367440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.368065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.368346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.368620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.380099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.381672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.382474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:25.383643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:25.397279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.398221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:25.399092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:25.399092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.399092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:25.399092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 278/567] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.399307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.416869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.454134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.464242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 290/568] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:25.465058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.508220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291231a4-6f7c-42d7-86f6-80893fe82ed5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.542675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.543280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.543561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.543832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.544543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:25.544842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.546296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.563257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 279/569] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:25.568996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.576568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b8a79-027a-4640-b979-c477aad7aa0f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.612235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.612933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.613140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.613408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.620195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.621634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:25.633358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.634285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:25.635186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:25.639189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 291/570] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.639783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.641027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.672820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387446a0-f503-4e1a-8900-c3a0226359be None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.696024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.708671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.709895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.710274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.710617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.711320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:25.711692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.713135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.729257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 280/571] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:25.729257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.745314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87e23-99ab-4df5-8880-d94ed35ba184 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.779348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.779954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.780234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.780502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.790788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:25.795541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.796624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 292/572] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.797723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.828711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ee933-04a2-4a5f-a2eb-a568d36d8bd5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.856989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.862753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.863447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.863793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.864135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.874817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.876263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:25.890765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:25.891825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:25.893051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:25.893051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:25.893051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:25.893051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 281/573] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:25.893051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.901338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5b37-5fe5-44de-9406-c6fcccd3e174 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:25.917748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:25.936025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:25.936647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:25.936930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:25.937198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:25.937874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:25.938202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:25.939611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:25.951180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 293/574] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:25.951949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:25.991968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e3b8b-4fd3-48fb-aa5c-4dbdf14db3aa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.025289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.025916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.026260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.026537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.034793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.036227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:26.047888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.049003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 282/575] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.050195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.055974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c430e9-fbbd-47a2-960b-b8c9f36b4a44 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.089520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.090169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.090451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.090724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.094309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.101432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:26.106624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.107692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 294/576] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.108682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.143155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.150991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172e83d-5f6a-4d2e-b75c-10ee8c21a15d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.183442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.184046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.184327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.184601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.185259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.185559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.187008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.195937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 283/577] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.196734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.209221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188783d-b50f-4d42-a6bf-9669a092398f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.242455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.243049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.243320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.243589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.244221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.244517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.245891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.262572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 295/578] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.262572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.297233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b2d0e-2845-4ecb-b748-7f90e08ae386 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.304438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.330542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.331146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.331431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.331707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.332422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=acb5646ccfe0421591346d235e8f3cf9) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.332734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.334229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.339431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 284/579] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/role_assignments?user.id=acb5646ccfe0421591346d235e8f3cf9&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.340203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.356162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.364175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5ebda-e22f-45a0-afb9-8393614c64d6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.408812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.410400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.410837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.411287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.412812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.413564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.416194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.439473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 296/580] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.440838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.452839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8c6ab-0dcb-4de8-801b-987af138193d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.494234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.494889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.495169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.495442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.497742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.498087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.499503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.514527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 285/581] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.519181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.551651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.559320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ed9d-bde5-4a27-aec7-88becaa91ded None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.598383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.599014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.599292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.599632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.610142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.611572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.624933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127191d-5b1e-49c8-9a22-c12ad847fb3e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:26.625833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.627341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:26.628225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:26.628225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.628225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:26.628225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 297/582] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.628225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.640301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.666356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.666998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.667280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.667551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.676059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.677869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:26.690387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.691407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:26.692288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 286/583] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.692791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.742602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d747f1-0c59-466b-abfe-58d4708d8196 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.779627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.780263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.780643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.780929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.787749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.796152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.797217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1533cc-6e5f-4a41-9d20-7d014ed91c4e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.797659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:26.814169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.815129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:26.815985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:26.815985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.815985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:26.815985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 298/584] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.816962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.837898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.838576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.839310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.839647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.851597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.853065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:26.872342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:26.873343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:26.874414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:26.874414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:26.874414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:26.874414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 287/585] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:26.875711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:26.893142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:26.939811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ec70d-aa1d-4c9a-810a-d6006ca78f58 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.976323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:26.976858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:26.977161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:26.977511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:26.978289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:26.978594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:26.979969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:26.981053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d737-ec6c-4526-aece-bda4a41a7daa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:26.997093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 299/586] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:26.997093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.020477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.021092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.022143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.022433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.023127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.023433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.024888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.041970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 288/587] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.041970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.046298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.107967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac430-e5c5-4eb1-8675-52317dbe7b64 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.126632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.145929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.147166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.147449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.147728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.148372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.148674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.150081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.151034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e3-5653-4ae1-885d-05749bbbdfad None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.163356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 300/588] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.163356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.197667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.198317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.198601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.198878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.199529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.199835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.201240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.214662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 289/589] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.215520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.278670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f67c1-01f4-488d-afde-a75aac4d8e47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.288376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.315270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.316118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.316406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.316686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.324667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.326173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.328103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed79d6-c3a3-4bcd-ab12-cf545679c9be None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:27.337547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:27.338751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 301/590] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:27.339991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.369644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.370382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.370612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.370891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/64455ea032c24c999e904095081c7aad` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.382191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.386467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=b1c4541fb9874e818b90fba97a1fdb20, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.387913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.409981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 290/591] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:27 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:27.409981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.460862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec492c9-7c25-4e8b-9377-5a76c5a202c9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.501461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.502587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.502872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.503143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.511913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.513368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:27.526499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:27.527508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:27.528419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 302/592] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:27.528960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.578386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9f2da-1137-4455-b8dc-694ae6e6eae6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.594846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.628704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.629346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.629627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.629898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.640224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.641313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:27.659809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:27.660792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:27.661726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:27.665934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 291/593] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:27.666944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.682939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.688263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa48c-b50a-4435-8cca-9066ab3bf722 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.733295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.733909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.734269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.734545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.735287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.735593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.737482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.765798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 303/594] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.765798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.794753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1853-4824-41e0-980c-813e77fac8d5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.831136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.831816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.832252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.832632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.833425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.833925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.835938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.852657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 292/595] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.854047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.889499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2a44-288c-4197-8d76-d8774993c754 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:27.910368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.926094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:27.926857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:27.927238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:27.927646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:27.928536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:27.928941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:27.930539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:27.954640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 304/596] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:27.955763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:27.972149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:27.982741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c0b28-43a7-440a-bf04-b9bb92a4913c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.027212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.028359 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.028787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.029201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.042136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.044514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.061340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f20b-20e2-476a-8c37-3fa817e2cb88 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:28.063238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:28.064283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:28.065136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:28.065136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:28.065136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:28.071070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 293/597] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:28.072443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.100799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.101635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.102146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.102519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/6fc5a9468ff5431e972345db08ac876d/roles/64455ea032c24c999e904095081c7aad` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.119107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=6fc5a9468ff5431e972345db08ac876d, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.120697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.136436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 305/598] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:27 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/6fc5a9468ff5431e972345db08ac876d/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:28.146690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.180693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:28.199638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe3135-3d6d-4982-aabe-03d6a9854eaa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.241301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.242267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.242851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.243263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.256886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.259037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:28.276729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:28.277916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:28.279003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:28.279003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:28.279003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:28.281348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 294/599] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:28.286355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:28.289694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.351629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719213-30c9-4a90-b0ca-c94b9835cbf2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.395366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.396038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.396565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.396908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.397599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:28.398622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.400398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.416505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 306/600] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:28.422315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.528918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a33922-a2c7-4a72-a9ba-0caaec47126d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.599303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e547185-38ff-49ae-a714-b2a3f44d9fb3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.611714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.612740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.613389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.613910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.614837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:28.615881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.620018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5309-0b9a-43f7-b43d-7cd2429477df None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.626299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:28.634477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:28.641030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.641661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.641958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.642251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.643412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 295/601] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:28.648041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff47b0-98c4-477f-93d6-04dad24ff1fa None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.648497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff47b0-98c4-477f-93d6-04dad24ff1fa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.648979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff47b0-98c4-477f-93d6-04dad24ff1fa None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.650746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 296/602] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:28.651738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff47b0-98c4-477f-93d6-04dad24ff1fa None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.654511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.655822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e5b9bc00-3b2f-4cd0-81c8-c41b19808810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:28.670957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:28.671873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:28.672737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:28.674145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 307/603] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:28.675347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.675695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.675895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.697970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:28.699178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:28.773979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff47b0-98c4-477f-93d6-04dad24ff1fa None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:28.805344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 308/604] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:28.806483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:28.816269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:28.817630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:28.818210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:28.818735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:28.827613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:28.829756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:28.848626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:28.850472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:28.851330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:28.857975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 297/605] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:28.860759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.016295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.081426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6fd34-9276-44bb-b8f5-fd29c12e8895 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.113127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.134954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2823ae-2644-4baf-a570-e2765aa49491 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.160442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.161062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.161338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.161608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.163446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:29.163446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.164626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.195977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 309/606] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:29.195977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.210781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.211406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.211689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.211970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.212665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:29.212972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.215718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.230241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 298/607] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:29.231511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.307008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e5cf-130d-4ecc-aef2-d102799fa927 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.344882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.345588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.345985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.346379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.351485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bc060-6018-44a3-b13c-e59be5473058 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.357471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:29.362865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:29.364028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:29.365135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:29.370658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 310/608] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:29.371428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.374412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.395758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.397375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.397854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.398340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/5cef70055b3f49ed9a1aabd221877bdc/roles/64455ea032c24c999e904095081c7aad` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.409021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.416917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=5cef70055b3f49ed9a1aabd221877bdc, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.419569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.435695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 299/609] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:29 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/5cef70055b3f49ed9a1aabd221877bdc/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:29.436988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.534519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c184cf9-93a5-416a-9c84-84daa5ee91f1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.607144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.608250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.609093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.609553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/2e694edc3a35429b8a2041261f9459e3/roles/64455ea032c24c999e904095081c7aad` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.636842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d893c6-e8ad-46c3-899e-d05083bf16c7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.651531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=2e694edc3a35429b8a2041261f9459e3, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.653026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.671587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 311/610] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:29 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/2e694edc3a35429b8a2041261f9459e3/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:29.691998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.692642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.692920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.693879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.694767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:29.695086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.696563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b923b-9b58-448e-8485-f5e96019876b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.707694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 300/611] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:29.713435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:29.796069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacbce-d2cc-48d8-8d25-f4bb61c3a80c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.796255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacbce-d2cc-48d8-8d25-f4bb61c3a80c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.796533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceacbce-d2cc-48d8-8d25-f4bb61c3a80c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.798024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 301/612] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:29.804168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.804780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.805274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.840428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:29.841656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:29.854505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.891888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5ad8a-1c2a-4d78-9efe-e32d8598d4e5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:29.897894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:29.950305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:29.950938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:29.951215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:29.951594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:29.960956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 302/613] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:29.963374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:29.964833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:29.980144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:29.981122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:29.982063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:29.982063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:29.982063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:29.985835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 312/614] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:29.987247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.108122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a859fc1-8f21-41c0-a55f-c0abad00996e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.149856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.150826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.151291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.151744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.152560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:30.153041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:30.154686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:30.173413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 303/615] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:30.179713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.252915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.298197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:30.338705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bb727-88fa-4f17-be92-4fe23f188c5f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.382193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.382748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.383027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.383298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.398209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:30.400548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:30.402100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:30.420024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:30.421046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:30.422433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 313/616] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:30.429759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.442693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154db3d9-f198-4997-8f97-7ca0dcc5c82a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.502567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.503204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.503486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.503757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.523494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:30.528680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:30.529573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:30.530423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:30.531608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 304/617] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:30.537797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.617451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede83de-ed3b-4482-8167-c33caaafc3c5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.676831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.677968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.678259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.678529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.679262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:30.679563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:30.680991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:30.686267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:30.706797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 314/618] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:30.715306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.720806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca6e99-0803-47fe-b786-1943ffc373b3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.757281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7803-9592-4047-a15c-252451688618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.757913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7803-9592-4047-a15c-252451688618 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.758230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7803-9592-4047-a15c-252451688618 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.758506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7803-9592-4047-a15c-252451688618 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.759178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7803-9592-4047-a15c-252451688618 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:30.759491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7803-9592-4047-a15c-252451688618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:30.760865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7803-9592-4047-a15c-252451688618 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:30.770341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 305/619] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:30.778760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7803-9592-4047-a15c-252451688618 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.852044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:30.901698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97de8-5bc2-4686-b3ff-8432771c340d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.947980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:30.948539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.949067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.949343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.956060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7803-9592-4047-a15c-252451688618 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:30.962564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:30.964020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0d710b06-f086-4462-8c76-12f879535232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:30.982039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:30.982995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:30.983878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:30.983878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:30.983878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:30.983878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 315/620] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:30.989227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb367-670f-4314-99d8-05d53de634c0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:30.989520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb367-670f-4314-99d8-05d53de634c0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:30.989797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb367-670f-4314-99d8-05d53de634c0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:30.995829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 316/621] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:30.995829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb367-670f-4314-99d8-05d53de634c0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:30.999345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.000187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.000625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.001070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.014672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.016768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-845a22cc-a6be-40f3-bc7e-c9c8c8f59fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:31.033416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:31.034579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:31.035678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:31.035678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:31.035678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:31.039128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.042025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 306/622] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:31.044234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.044874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.045372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.069236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:31.071684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:31.130614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb367-670f-4314-99d8-05d53de634c0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.138040 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.168468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.169189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.169548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.169931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.175425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:31.175425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.175425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.175727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 307/623] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:31.175727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.194901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 317/624] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:31.201793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.351381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81698c54-f31b-4a54-a22f-9e26e9841960 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.395979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.397141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.397422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.397699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.403168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d05d68-c6ab-4afc-a8f1-46ce93094cb4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.415501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.416972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:31.432253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:31.433164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:31.434122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 318/625] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:31.439830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.466393 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.477894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.478572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.478861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.479156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.479816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:31.480142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.481540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.488925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.520165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 308/626] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:31.525798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.578910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e918ad-1de6-4c12-a627-9a9d419cfec9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.625297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.626215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.626502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.626783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.628047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:31.628761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.631296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.634770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d537a0-fed1-444e-b3ee-ca8495cb4a1d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.650037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 319/627] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:31.650903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.686265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.687163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.687833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.688131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.705489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:31.712962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:31.713863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:31.714835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:31.715475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 309/628] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:31.716058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.747918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.772101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c19f3-f227-4ad1-88f2-9db901054e3e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.778274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:31.825661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.827245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.828032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.828495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.839686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.839873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe947c0-70e7-4f07-acb1-bfb8db012f3d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:31.841779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:31.857738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:31.858796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:31.859727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:31.863941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 320/629] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:31.865136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.890057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:31.891795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:31.892438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:31.893035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/acb5646ccfe0421591346d235e8f3cf9/roles/64455ea032c24c999e904095081c7aad` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:31.914917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=acb5646ccfe0421591346d235e8f3cf9, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:31.916373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:31.933366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 310/630] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:31 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/acb5646ccfe0421591346d235e8f3cf9/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:31.934378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:31.987204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01277c-8dcb-4046-95a0-ebd2dde709c5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.027890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.029001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.029516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.030077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.031001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:32.031605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.033517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03456-24e7-4ea4-9777-90f4da987bbe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.044509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 321/631] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:32.050718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a86a0b-0273-47bd-bc70-0ac0eb8ecf32 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.051339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a86a0b-0273-47bd-bc70-0ac0eb8ecf32 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.052157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.054034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a86a0b-0273-47bd-bc70-0ac0eb8ecf32 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.060416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 322/632] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:32.060416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a86a0b-0273-47bd-bc70-0ac0eb8ecf32 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.066794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37ef4-c597-433f-8b01-83a0560feaea None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.076308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.114657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.115365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.115648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.115992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.116766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:32.117121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.119939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90fdf9-3e09-49ee-8b9f-cc24d530ee47 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.150025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 311/633] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:32.151550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.151844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.152123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.171692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:32.172900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:32.206047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a86a0b-0273-47bd-bc70-0ac0eb8ecf32 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.244542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.245622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.246395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.247084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.258193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 312/634] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:32.259163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.259330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.260831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-15679fe6-c0c4-440c-8344-8750d2d89d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:32.285453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:32.286412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:32.287357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:32.287357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:32.287357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:32.287357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 323/635] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:32.292618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154032f-42e3-489d-8e15-307b496dfb6b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.292618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154032f-42e3-489d-8e15-307b496dfb6b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.292618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154032f-42e3-489d-8e15-307b496dfb6b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.292618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 324/636] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:32.295402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.295687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.295965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.317309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:32.319653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:32.365140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.387806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5646ad-b405-4d30-b69e-4115a5ba5949 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.397727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.418008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 325/637] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:32.419199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.449540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.450538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.451035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.451548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.572322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b35f2-207d-42cf-aee4-2af7f43af377 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.577246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.578742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.623098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.623718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.624001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.624737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.625394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:32.626143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.628178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.644797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 326/638] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:32.645975 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.668810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.691784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 313/639] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:32.692733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.714619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.777616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d054095-4429-40f8-9a0d-c2eea7fe573e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.805150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b1ad-9b4f-4d5f-8122-2ea6d1d26598 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.816536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.817370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.817663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.818072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.829679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:32.834892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:32.835851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 327/640] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:32.836780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.848807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.850087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.850577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.851053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.860900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:32.862365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:32.881114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:32.882157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 18:29:32.883112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:32.886413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 314/641] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:32.886937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:32.935039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.953816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4861-87c2-46ce-b2d3-ef73e7366386 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:32.965423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:32.993246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:32.993868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:32.994181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:32.994460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:32.998529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001468-fb72-4dfc-93e5-15d421c21cb4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.005180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.006692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:33.020639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:33.021669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:33.022913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:33.022913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.022913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:33.022913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 328/642] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:33.022913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.040096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.040730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.041007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.041279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.052062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:33.057869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:33.059331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 315/643] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:33.060213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.136839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44024f-4fe4-4a03-9777-b149c129e176 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.173729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.174469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.174755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.174854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9c21-5c4a-4112-a354-f8d0f394affe None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.175025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.175693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:33.175996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.178200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.180366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.189362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 329/644] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:33.190864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.214471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.215079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.215388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.215665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.216615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:33.216723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.218147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.220479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.237463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 316/645] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:33.238602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.308761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c63859-09d7-45f8-a257-96552950dd83 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.345556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.346196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.346479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.346755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.347404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:33.347708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.349070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.355095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488321-100d-419a-8e04-332a2bd88683 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.361606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 330/646] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:33.362444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.394657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.395192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.395467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.395743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.396918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:33.397220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.398794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.413814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 317/647] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:33.413814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.438213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.453971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.470693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6137-2163-4a0b-a1e7-784fd0bd1387 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.513015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.513649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.513929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.514466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.524794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.526273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.535046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a232be-a653-4bbd-8d87-543a12cdb603 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:33.540770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:33.541719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:33.542686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:33.542686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.542686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:33.542686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 331/648] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:33.542686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.577245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.577855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.578199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.578451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.646874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d14c02-75e7-44a3-bd2b-2ea2a289ab84 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.651940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.653610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.678830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.681376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.682131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.682489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.682833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.685702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.690449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.692373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:33.704404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:33.705315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:33.706258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 332/649] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:33.706735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.770741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 318/650] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:33.771787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.829704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25139-d7d1-49f9-8704-e61cb70924f6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.867618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.868246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.868523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.868795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.879480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.880947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:33.894638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:33.895566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:33.896476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:33.896476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:33.896476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:33.896643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f290aa4-d822-4621-a460-14da12f0df87 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:33.896715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 333/651] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:33.897380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:33.923282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.936171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:33.936778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:33.937057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:33.937329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:33.938012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:33.938310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:33.939670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:33.950415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:33.955459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 319/652] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:33.955459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.011879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20133c92-7743-4985-b42f-e95757e373e2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.047523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.048172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.048416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.048689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.049377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.049683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.051146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.059093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0ffe-7fe2-4ac7-9205-7c57da822b69 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.069079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 334/653] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.069079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.098689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.099995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.100328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.100902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.113115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.114624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:34.134553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:34.135561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:34.136462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:34.136462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:34.136462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:34.142362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 320/654] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:34.144285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.182428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9de657-d2e1-42d6-b353-5f53ea4167ca None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.185688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.193160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.220818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.221441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.221724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.222021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.222671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.222970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.224918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.236655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 335/655] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.237550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.256484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cf144-6039-4a02-bc86-409c401b6e91 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.290944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.291583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.291869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.292147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.299272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.300694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:34.311890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:34.313029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 321/656] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:34.314344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.343568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119a660-e4ba-4a66-89ab-b1a6a4e3da33 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.376644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.377496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.377777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.378076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.378794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.379100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.380543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b430d2-4d27-40d0-8e97-b12105ff88c7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.386159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 336/657] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.387356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324654dc-1774-46d6-b17a-8524cbb79e32 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.387646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324654dc-1774-46d6-b17a-8524cbb79e32 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.387919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324654dc-1774-46d6-b17a-8524cbb79e32 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.389170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 337/658] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:34.389878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324654dc-1774-46d6-b17a-8524cbb79e32 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.414345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.422892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c5b09-4d7f-4b17-87ad-97e51b7d0460 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.435523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.464221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.464953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.465246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.465522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.466208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.466515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.467918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.481596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 322/659] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.487029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.516761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324654dc-1774-46d6-b17a-8524cbb79e32 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.552524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.553159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.553438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.553709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.562949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.564419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f0dc16f5-8651-41e6-b4dc-d9c1fee43347 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:34.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:34.578424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:34.580241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 338/660] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:34.580839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.580839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.580839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.601384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:34.602603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:34.609710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce74a0-8db6-4d0e-a0cd-2e0490385a51 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.656134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.656990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.657298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.657930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.658688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.658994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.660931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.673638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 339/661] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:34.678025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.687549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 323/662] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.692654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.704885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.712225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.805248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5da91-a5c5-4faa-bdd9-a3222e79b7f3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.806024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225341d7-2ac1-4fa1-b7cd-d1c5e08997d5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.843729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.844196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:34.844903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.845226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:34.845360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.845643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.845973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:34.846543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:34.847477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:34.847912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.849594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.853076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:34.854626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:34.867055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:34.868134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:34.869192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:34.870451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 340/663] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:34.871356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.871704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 324/664] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:34.879061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:34.950854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.967817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:34.983256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae849-3dc9-4a65-943e-90844066364d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:34.993241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f674c-c76b-4f6f-b236-db319038938c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.018482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.019239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.019617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.019982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.030458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.031420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.031704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.031980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.088131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.089722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.117188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.119317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.159742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.195666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 325/665] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:35.196428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.213874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.238141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 341/666] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:35.238141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.305168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41f902-9e74-4801-b323-9a0bf0b3856b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.343950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.344567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.344850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.345125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.345814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:35.346170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.347580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.352550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a4dcb-b51b-4736-9127-62c96547f27b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.359786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 326/667] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:35.360585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.393022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.397153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.398066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.398454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.398821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.409172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:35.414602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:35.415690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:35.416735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:35.418453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 342/668] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:35.423732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.465508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f4b7f-9975-4048-9c6a-a3fdb40a1caa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.468490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.502795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.503413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.503690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.503962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.514434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.515939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.529867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae713d-9d57-42e8-855e-3e125bca6c8b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:35.530344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:35.531425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:35.532497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:35.532497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:35.532497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:35.538671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 327/669] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:35.538671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.567945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.568570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.568848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.569124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.579787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.581199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:35.595749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:35.596896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:35.597772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:35.597772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:35.597772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:35.597772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 343/670] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:35.598029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.627885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.649695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c031ca-82c8-4a51-b08b-bb37dcb96cd1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.686268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.686934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.687217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.687509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.688252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=6fc5a9468ff5431e972345db08ac876d) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:35.688564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.690005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.696651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 328/671] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/role_assignments?user.id=6fc5a9468ff5431e972345db08ac876d&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:35.697452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.710825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.721753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a63904-7f9b-4084-b446-1bc7b3e5d57f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.776366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.777261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.777991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.778433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.779641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:35.780110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.782748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.800911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 344/672] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:35.803114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.820461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a666-30e2-4c0f-a2b1-631f0dcce8dc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.858847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.859475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.859757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.860033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.860687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:35.860991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.862819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.875813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 329/673] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:35.876773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:35.886105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:35.926646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6783198-2925-4234-8283-03556a8102b0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:35.965222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:35.965837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:35.966147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:35.966423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:35.967067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:35.967373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:35.968740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:35.982148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 345/674] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:35.982709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.001666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.004923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aad5f-620e-4414-935e-be9473b0fbf0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.057752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.059944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.059944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.059944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.073581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.074923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:36.094449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:36.096027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:36.097098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:36.097098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:36.097098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:36.099474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 330/675] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:36.100494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.115064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d04c8-2c8b-4092-aa4b-dbfe2c8e3aae None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.156949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.157863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.158310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.158744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.168750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.170907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.176466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:36.188753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:36.189852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:36.190966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:36.199410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 346/676] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:36.200571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.231709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf503-37f4-4287-9a77-939b8ac83eac None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.275812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.277307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.277738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.278184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.287108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.289050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.299718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:36.306236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:36.307309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:36.308408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:36.311076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 331/677] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:36.311682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.338001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dd1a-2c30-4dec-8dad-7010818bdde1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.374696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.375310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.375590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.375865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.376509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.377057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.378818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.392172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 347/678] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.393012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.440392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a738-e1cf-4d0d-8b77-54bd82de9472 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.460497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.480145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.480758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.481040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.481313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.482031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.482340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.483761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.497793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 332/679] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.497793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.520856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cde33-c36b-4975-abc3-67c20276e7fa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.564889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.565485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.565766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.566166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.567222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.567332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.568773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.571969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.584718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 348/680] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.585624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.629622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622a87-218c-40f2-9e98-3547b06d10af None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.666518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.667143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.667482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.667756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.675121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.676702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:36.688794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:36.689822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 333/681] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:36.690801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.698759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19ae16-26a1-474d-860f-e7a2ff17fa8b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.733902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.734543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.734824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.735133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.735821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=2e694edc3a35429b8a2041261f9459e3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.736131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.737551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.737668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439201-4948-40ca-a332-2ee425da9ae3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.744658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 349/682] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/role_assignments?user.id=2e694edc3a35429b8a2041261f9459e3&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.746281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c80d3-01c7-4ff5-b43d-9adedd321e81 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.746568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c80d3-01c7-4ff5-b43d-9adedd321e81 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.746850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c80d3-01c7-4ff5-b43d-9adedd321e81 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.752704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 350/683] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:36.752704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c80d3-01c7-4ff5-b43d-9adedd321e81 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.823863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e367-7679-4bcb-a2f6-d474c2eb4343 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.842506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:36.866939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.867339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.867571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.867842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.868568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=5cef70055b3f49ed9a1aabd221877bdc) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.868954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.870351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19b8a-5433-4a38-a4e3-6e13b918228d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.878480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 334/684] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/role_assignments?user.id=5cef70055b3f49ed9a1aabd221877bdc&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.879853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.880145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.880954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.898728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c80d3-01c7-4ff5-b43d-9adedd321e81 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:36.903778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:36.905039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:36.942104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:36.944109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:36.944573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:36.945037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:36.946091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:36.946571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:36.948407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:36.970073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 351/685] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:36.980586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:36.988827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 335/686] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:37.102103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5789e52-4405-4660-8361-befe79b7a06b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:37.121523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:37.140241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:37.140853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:37.141137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:37.141413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:37.215110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:37.216584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:37.305602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.343172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 352/687] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:37.350955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.365848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:37.380023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:37.440393 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db210c01-e836-4b98-bc11-3154dc8d476e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:37.486540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:37.487180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:37.487461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:37.487738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:37.511425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:37.519285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:37.520232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:37.521685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 336/688] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:37.526859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.545719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ec841-b5b9-4a21-ba98-53407a5beeb5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:37.582623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:37.583257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:37.584098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:37.584374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:37.595416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:37.597120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:37.615717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:37.616753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:37.617638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:37.617638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:37.617638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:37.617638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 353/689] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:37.625438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.682863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:37.690690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c23a0-1372-4f0e-bfd9-3f897eda74be None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:37.726953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:37.730963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:37.731826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:37.732302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:37.732786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:37.733656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:37.734321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:37.735933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:37.746919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 337/690] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:37.756183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.764516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58300f4-de89-4051-a688-c4d26bdff102 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:37.813884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:37.814525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:37.814810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:37.815084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:37.815737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:37.816041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:37.817428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:37.844753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 354/691] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:37.850406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:37.961147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b35a88-ae7d-40c5-9d1c-db506035c623 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.002322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88fde-c28e-4f6e-9f5e-468e3839625d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.025720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.026917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.027397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.028005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.040600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.042228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.043761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:38.061275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:38.062373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:38.063250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:38.063250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:38.063250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:38.063419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.063419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.063572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.064130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.065968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 338/692] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:38.072003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.085392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.087281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.098370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:38.116407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:38.117350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:38.118264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:38.122396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 355/693] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:38.123222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.224701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5abb3-d8a6-46c4-8f57-ac41dffd58ef None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.275223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.276203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.276724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.277220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.284490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:38.285035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.287172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8034fc-b00a-4c68-b351-c40e22c62e7c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.301554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ff87-02ac-4f93-bc34-b6678a6741b8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.303279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 339/694] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:38.304721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef2824-01a7-4071-bbd6-9136462e1cf8 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.305222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef2824-01a7-4071-bbd6-9136462e1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.305714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef2824-01a7-4071-bbd6-9136462e1cf8 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.307600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 340/695] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:38.308577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef2824-01a7-4071-bbd6-9136462e1cf8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.340027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.340666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.340945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.341217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.342208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:38.342515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.344119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdeba11-a44b-40c8-88ce-b52820e06da7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.360603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 356/696] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:38.362008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.362294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.362935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.384652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.385041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:38.386417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:38.426905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef2824-01a7-4071-bbd6-9136462e1cf8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.446161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.464859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.465811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.466352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.466832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.473697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 357/697] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:38.475460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.476031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.477680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:38.490436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:38.491382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:38.492353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:38.495217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 341/698] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:38.505019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.646514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e62949-8f1a-4bd5-94c9-b17a216eab00 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.674275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.682650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.683634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.684015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.684390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.685209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:38.685620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.687618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.706119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 342/699] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:38.707048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df44cc-d24c-49ad-9283-3dee4db4195d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.718924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.767044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.768033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.768508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.768973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.769904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=acb5646ccfe0421591346d235e8f3cf9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:38.770430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:38.774076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:38.788709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 358/700] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/role_assignments?user.id=acb5646ccfe0421591346d235e8f3cf9&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:38.789852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:38.886999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665afb2-275d-47f5-88df-a487a79bd0bb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:38.888994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:38.930330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:38.931411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:38.931695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:38.931971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:38.999601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.011856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.012350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4740374-3f12-4476-80f0-e3b2b25751b1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.013318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.055097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.056092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.056571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.057037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.073506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.075030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:39.093407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:39.094476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:39.096053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:39.096053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:39.096053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:39.096053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 359/701] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:39.100894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.131065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 343/702] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:39.136860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.226901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.234872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8b22-03d7-4f9c-a821-09687122d787 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.253719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.287220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcd8dc-8afe-4a6c-9f5e-2d76991f930a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.294966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.295979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.296446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.296925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.297842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:39.298405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.300053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.315628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 360/703] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:39.322938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.331708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.332372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.332710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.332991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.344724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.346221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:39.362086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:39.363110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:39.364029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:39.364029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:39.364029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:39.364029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 344/704] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:39.369416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.459499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780e28-9af0-4de8-9dee-fd8694ad227a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.502272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.503281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.503761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.504209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.505078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.507866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1db43-570a-4328-9e0a-57139d394620 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.536110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11393025-5cb6-45c7-b303-be36c2d23fd0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.540661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 361/705] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:29:39 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:39.542522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37be3-8fa7-4df1-8090-807e05d4c4a0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.543026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37be3-8fa7-4df1-8090-807e05d4c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.543536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37be3-8fa7-4df1-8090-807e05d4c4a0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.546304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 362/706] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:39.552911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbb0-65a5-4d6e-b042-879fe93d5506 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.553137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbb0-65a5-4d6e-b042-879fe93d5506 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.553402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbb0-65a5-4d6e-b042-879fe93d5506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.577704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8368cbb0-65a5-4d6e-b042-879fe93d5506 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:39.579396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8368cbb0-65a5-4d6e-b042-879fe93d5506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:39.584426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.585305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.585768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.586247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.587102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:39.587971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.588848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.590610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.593814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.608593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 345/707] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:39.614314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.675545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 363/708] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:39.692497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da885-dfc8-45fa-8b13-6037b3a716e2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.693908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da885-dfc8-45fa-8b13-6037b3a716e2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.694219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da885-dfc8-45fa-8b13-6037b3a716e2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.696482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 364/709] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:39.702457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.702771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.703015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.743084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:39.744683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:39.796742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153586-0b99-4869-9e58-fa49da334ca8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:39.838664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 365/710] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:39.846659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:39.847590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:39.848070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:39.848541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:39.856586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:39.858313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:39.870526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:39.871415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:39.872316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:39.874637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 346/711] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:39.880309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.954863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:39.967294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:39.990611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c4b69-7fef-42ab-82b0-e4442e2c69cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.033412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:40.035815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.036951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.037256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.037535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.038300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.038609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.040078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.054748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 366/712] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:40.066983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.115388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ad36b-955a-4d41-9112-a86e1c072738 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.176656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.177748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.178341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.179625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.180474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.182391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:40.194920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:40.196064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:40.196901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.199777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 347/713] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 8 18:29:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:40.200781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.221705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18150-8089-4486-b703-9512a64dfd2a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.253256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:40.261015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.261927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.262551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.263023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.264028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.264540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.266240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.273974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 367/714] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:40.279142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.364041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc562-3f76-4d37-9381-5e8fff2047ce None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.406356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:40.421154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19387ca-d9f2-4eb0-a971-2a547ebc3f50 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.454963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.455427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.455713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.455989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] PATH_INFO: `/v3/services/network` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.456593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.458104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.462065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.462969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.463592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.464085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.464981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.465488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.467125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.472662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 368/715] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:40.474992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:40.475939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:40.476760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:40.478915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.480734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 348/716] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:40.489256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.577175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:40.664060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc59b-1363-474c-8cbc-3fbd25af846a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.664428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12ec1-5ca8-4093-9362-4f940e3cb763 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.707297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.707913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.708192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.708499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.709135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.709437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.711834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.714933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.715549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.715827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.716098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.716724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.717024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.718394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085627a-5cc1-4444-8da2-01d0f3229cc9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.726496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 369/717] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:40.733047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 349/718] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:40.734511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:40.851603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5059c-6c82-4170-b7ea-61974b86256d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:40.878209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:40.899956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:40.901003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:40.901493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:40.901997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:40.902865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:40.903386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:40.905075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d73e72-9563-403f-b921-b9babf452fd8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:40.911314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 370/719] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:41.790496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d327-51e3-47b6-ad50-d55a717b7e25 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:41.791006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d327-51e3-47b6-ad50-d55a717b7e25 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:41.791113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d327-51e3-47b6-ad50-d55a717b7e25 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:41.792596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 350/720] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:41.798022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:41.798454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:41.798630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:41.826192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:41.827404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:41.903628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 371/721] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:42.237801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861d327-51e3-47b6-ad50-d55a717b7e25 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:42.303981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:42.379625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861d327-51e3-47b6-ad50-d55a717b7e25 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:42.421494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:42.422166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.422452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.422730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.439125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-18866ca6-8544-47a7-a651-09ebf593abda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:42.444524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:42.445434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:42.446328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:42.451695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 351/722] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:42.457604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:42.588836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe5a-909f-4989-992f-7f7b24a58468 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.589446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe5a-909f-4989-992f-7f7b24a58468 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.589920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cfe5a-909f-4989-992f-7f7b24a58468 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.590384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c43d2-f79a-4aac-ad26-552b0879f9cd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:42.591927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 352/723] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:42.597171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9c4f-9ed5-4af8-b5f8-a4fd4534d130 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.597705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9c4f-9ed5-4af8-b5f8-a4fd4534d130 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.598256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9c4f-9ed5-4af8-b5f8-a4fd4534d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.623107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:42.633833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-587e9c4f-9ed5-4af8-b5f8-a4fd4534d130 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:42.635059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-587e9c4f-9ed5-4af8-b5f8-a4fd4534d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:42.637410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:42.638050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.638335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.638651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.639334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:42.639640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:42.641023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:42.663408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 372/724] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:42.666813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:42.773064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 353/725] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 18:29:42.828645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9af57-cc49-4425-b659-288f34cafba8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:42.882025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:42.882588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.882873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.883149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.894305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:42.896379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:42.906715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf21c8-3b44-4d2c-ba5f-11425dc80646 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.907583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf21c8-3b44-4d2c-ba5f-11425dc80646 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.908052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf21c8-3b44-4d2c-ba5f-11425dc80646 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.909849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 354/726] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:42.914566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:42.915067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:42.915539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:42.916887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:42.917860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:42.918812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:42.918812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:42.918812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:42.918812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 373/727] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:42.925986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:42.955285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:42.956467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:42.987145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.022148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.099056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 355/728] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:43.121227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ce0b-2eac-4a4b-9f1c-09666f51cbe3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.166309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.169859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.170696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.170991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.171273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.171931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:43.172241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.173625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.199036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 374/729] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:43.204852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.368548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.377631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e344f1-e15d-4c85-9e8d-8024312df614 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.381247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd27ae-2b2c-4955-af10-198fcfc22638 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.431067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.431623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.431906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.432178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.445614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.446286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.446569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.446843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.452337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:43.457163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:43.459320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:43.461312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 356/730] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:43.465966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.465966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.466169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:43.479189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:43.480187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:43.481111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:43.483888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 375/731] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:43.490285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.498260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.575442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce7b6-d78b-4c38-98a8-4492a04b422f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.598323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f751143-22bb-467b-a821-59ad34a41598 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.610613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.611249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.611533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.611808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.622585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2795d78a-85e5-4117-86dd-122bed4c3cb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:43.627598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:43.628560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:43.629428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 357/732] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:43.630172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06278-6d7f-4339-a6aa-60b428311696 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.630172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06278-6d7f-4339-a6aa-60b428311696 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.630616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06278-6d7f-4339-a6aa-60b428311696 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.631597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 358/733] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:43.632289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06278-6d7f-4339-a6aa-60b428311696 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.638437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.639052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.639334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.639609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.640277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:43.640582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.641962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306bd38-96c2-43c9-951a-0fdb559e841a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.651297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 376/734] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:43.652441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841a4a-6bdb-48fe-acf1-45bd4ec0f44a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.652730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841a4a-6bdb-48fe-acf1-45bd4ec0f44a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.653009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841a4a-6bdb-48fe-acf1-45bd4ec0f44a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.654222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 377/735] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:43.654919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61841a4a-6bdb-48fe-acf1-45bd4ec0f44a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.672188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.727240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.740791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06278-6d7f-4339-a6aa-60b428311696 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.758309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61841a4a-6bdb-48fe-acf1-45bd4ec0f44a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.773562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.774191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.774470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.774744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.775448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:43.775747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.777173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ecf94-8cd0-4618-875e-6764497ceefa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.792336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.793417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.793892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.794221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.794740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 359/736] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:43.794928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:43.795191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.795967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc291-7a50-4e80-98b5-0b97271b33fc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.796251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc291-7a50-4e80-98b5-0b97271b33fc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.796523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc291-7a50-4e80-98b5-0b97271b33fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.797259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.807029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 378/737] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:43.807835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.817515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-20cfc291-7a50-4e80-98b5-0b97271b33fc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:43.818732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-20cfc291-7a50-4e80-98b5-0b97271b33fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:43.884192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:43.885141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 360/738] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:43.887064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.887356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.887629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.907922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ca628-7744-4dad-a538-a9b0cf929dd3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:43.912222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:43.913409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:43.946168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:43.947279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:43.947854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:43.948191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:43.966058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:43.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:43.985375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:43.986353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:43.987231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:43.987231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:43.987231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:43.987231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 379/739] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:43.987872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:43.995082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 361/740] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 18:29:43.995856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.013815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.096347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ae9ca-0f0a-411c-9c4c-13e34aabd749 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.119134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404bb93-6d53-4c8d-960b-9210a03897da None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.124237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.133255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.134260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.134766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.135242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.158824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.159453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.159734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.160024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.171190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.172620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:44.187212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:44.188155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:44.189038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:44.189038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:44.189038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:44.189038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 362/741] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:44.189038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.215565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.217391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.251273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.295636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10210eb-b0e1-46ff-bdd7-7603398f7f7c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.329050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.329641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.329929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.330230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.330869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:44.331173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.332532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.337786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 380/742] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 18:29:44.337786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.343962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 363/743] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:44.344768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.365380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.438242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd89af-81f6-4ab9-beab-6a7b92f1caf5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.441530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1a2c5-9f62-4d59-9dbc-00bc83a3c354 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.459021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.471102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.471702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.471982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.472250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.472888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.474789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.476134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.476732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.477016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.477293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.477933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:44.478263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.479618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.490608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 381/744] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:29:44 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:44.491229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.495979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 364/745] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:44.495979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.599782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.616594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b65a5-3bc6-4f1e-a9f4-c6a68c1e33e0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.620577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19ecf-08a8-46ae-8fe9-298b3a414c12 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.658637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.659355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.659529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.659667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.660064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.660662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.660662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.660662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.660866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.662376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.674155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.675857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.686061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 382/746] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:29:44 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:44.687517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:44.691914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:44.693655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:44.694573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:44.694573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:44.694573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:44.694573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 365/747] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:44.695295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.735776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.824979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341db7e-6cbb-4e77-8f1b-7d5998877ecf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.831717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e9f8-4d8f-411f-bb52-ce6bfa17ab97 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:44.868997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.869564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.869846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.870155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.871800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:44.872439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:44.872726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:44.873387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:44.880998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.882020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:44.882507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.883578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:44.886431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:44.895757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:44.896874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:44.898028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:44.899158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:44.900242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:44.901404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:44.907261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 366/748] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:44.907403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 383/749] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:44.907483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:44.908138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.027364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830a0c-1539-4b63-8980-675872994108 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.031621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.044740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6dc3-93f7-43b0-a176-3a2f18cec470 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.064260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.064866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.065215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.065487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.066242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:45.066542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.068022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.091842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 384/750] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:45.093236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.095191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.096200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.096716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.097360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.098556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:45.099777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.101862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.130131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 367/751] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:45.131514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.172849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.220677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019565f3-0499-4a59-96b4-56f6149b3e15 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.254265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c7e8-f8a7-4baf-8811-9af3c4b063ad None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.260078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7491232-1154-480c-8405-feeb239a494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.260933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491232-1154-480c-8405-feeb239a494a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.261399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491232-1154-480c-8405-feeb239a494a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.261878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7491232-1154-480c-8405-feeb239a494a None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.262940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7491232-1154-480c-8405-feeb239a494a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:45.263431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7491232-1154-480c-8405-feeb239a494a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.265183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7491232-1154-480c-8405-feeb239a494a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.290185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 385/752] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:45.291048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7491232-1154-480c-8405-feeb239a494a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.297711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.298788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.299277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.299774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.311686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.313602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:45.330589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:45.331840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:45.332825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:45.332825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:45.332825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:45.336352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 368/753] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:45.337493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.340684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.415841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7491232-1154-480c-8405-feeb239a494a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.436809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.450807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af28c-2257-420a-a35a-e660cd2429cf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.462437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.463573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.464029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.464445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.473805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.476294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.487588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.488329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.488712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.489097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:45.492279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:45.493307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:45.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:45.502861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 386/754] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:45.504292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.581740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.583350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.585463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.660301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f04ae-a248-4451-8126-a14b022cba52 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.697780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.698346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.698679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.698879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.699516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:45.699814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.701284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.709880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 369/755] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:29:45.711073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.719242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 387/756] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:45.720128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.757632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.835697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686c80-4fb1-40ad-9bce-83df075878b9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.836508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f010b1-24b9-4525-be5a-c5ea9a05beb3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:45.837175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:45.873520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.874166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.874446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.874718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.875406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:45.875710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.877584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.878538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:45.879408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:45.879937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:45.880419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:45.889762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 370/757] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:45.890670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.892033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:45.894222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:45.910218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:45.911779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:45.912668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:45.912668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:45.912668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:45.914955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 388/758] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:45.916028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:45.993692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860579-10e7-4d85-a640-ff4c2a9b8067 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.011466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:46.025900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73c567-57c5-409a-bdd4-23a8709f40f7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.029921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.030599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.030879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.031153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.038823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.040255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:46.052535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:46.053424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:46.054340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:46.058199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 371/759] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:46.059121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.072268 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.073255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.073757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.074251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.075574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=acb5646ccfe0421591346d235e8f3cf9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:46.076124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.077830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.085236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:46.085741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 389/760] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:45 2022] GET /identity/v3/role_assignments?user.id=acb5646ccfe0421591346d235e8f3cf9&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:46.087349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.170861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470d09f-0f5e-4591-8cc8-d147a47901bd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.204475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9194-0c64-4051-8a38-cc079a001492 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.206672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.207316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.207595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.207871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.209849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:46.209849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.210881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.225129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 372/761] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:46.231023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.256495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.257629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.258209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.258707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.259610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:46.260122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.261869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.292221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 390/762] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:46.297105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.323449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:46.334279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:46.355350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efabef-4d65-4fcc-b305-8cb4cf05e866 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.394493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.395236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.395689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.396023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.403621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.405347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:46.417453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:46.418585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:46.419695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:46.420513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 373/763] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:46.425850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.469705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fb41a-cd92-4365-a464-8fb2c7327438 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.509303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.509891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.510210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.510480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.512396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=b1c4541fb9874e818b90fba97a1fdb20, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.513927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.552806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 391/764] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:46 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:29:46.566730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5cda-06d7-4ad8-8578-497da499d79c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.610665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.611356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.611647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.611924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.612694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:46.613007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.614729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a574-3853-4935-95fd-ca28f9f7e8c2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.630506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 374/765] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:46.636030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:46.753421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:46.789521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d8d82-9394-48cb-984b-5a124826c6da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:46.828507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:46.829123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.829402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.829677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.830451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:46.830762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:46.832366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b7b11-3a1c-489e-85ae-44f374470109 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:46.839758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 392/766] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:46 2022] GET /identity/v3/role_assignments?user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:46.979046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc3353-d3d5-41f0-a952-b911fcb3e9be None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.979749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc3353-d3d5-41f0-a952-b911fcb3e9be None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.980228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc3353-d3d5-41f0-a952-b911fcb3e9be None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:46.982064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 375/767] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:46.988159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:46.988704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:46.988704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.019504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:47.021434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:47.034478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1db6-cb95-4445-a6ac-1700ac8f4eb5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:47.034825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1db6-cb95-4445-a6ac-1700ac8f4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:47.035038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1db6-cb95-4445-a6ac-1700ac8f4eb5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.037215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 376/768] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:47.042676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:47.043230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:47.043230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.059833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:47.082263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:47.085306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:47.131491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 393/769] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:47.174738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 377/770] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:47.493904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:47.551032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:47.571144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:47.611673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2ce8-ea52-49cb-8254-04121640d320 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:47.651398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:47.652224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:47.652835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:47.653205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.653898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:47.655414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:47.668074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:47.669157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:47.670010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:47.670745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 394/771] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 8 18:29:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:47.679809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:47.736683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd737a-3426-49e7-8ec2-066795e776a3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:47.794828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3362cdf-5e26-4493-9314-6ff6e369d24d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:47.826655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:47.831079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:47.834315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:47.835661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:47.836753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:47.837700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.838573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:47.839861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:47.842086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:47.842860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:47.843780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:47.845371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:47.845847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] PATH_INFO: `/v3/services/network` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:47.846862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:47.849236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:47.852803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 395/772] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:47.862994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:47.866472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:47.867540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:47.868401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 378/773] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:47 2022] GET /identity/v3/services/network => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:47.877765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.000442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5afc1-ff03-4ebb-b110-2d4ae01dd9d6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.071676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.073183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.073773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.074800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.075784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:48.077753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfef8a7-49ce-4a5f-a00a-109c9b5e4c98 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.078622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.080171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.091648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 396/774] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:48.099800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.150337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14920670-4763-4334-a1e4-37933d212837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.151246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920670-4763-4334-a1e4-37933d212837 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.151732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920670-4763-4334-a1e4-37933d212837 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.152181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14920670-4763-4334-a1e4-37933d212837 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.152997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14920670-4763-4334-a1e4-37933d212837 None admin] RBAC: Adding query filter params (name=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:48.153479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14920670-4763-4334-a1e4-37933d212837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.155362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14920670-4763-4334-a1e4-37933d212837 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.160664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 379/775] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:48.166715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14920670-4763-4334-a1e4-37933d212837 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.240676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:48.245077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:48.293302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14920670-4763-4334-a1e4-37933d212837 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.336903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.337884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.340115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.340634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.341830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] RBAC: Adding query filter params (type=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:48.342373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.345859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.351880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887ec4e-c114-4dc6-8f15-8bf20253d9c1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.354323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 380/776] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:48.365255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.435578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.435980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.436308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.436587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.437292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] RBAC: Adding query filter params (interface=public, service_id=254fcbca25ba4e17930f9649dadda22a, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:48.437609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.439078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.462339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 397/777] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:29:48 2022] GET /identity/v3/endpoints?service_id=254fcbca25ba4e17930f9649dadda22a&interface=public®ion_id=RegionOne => generated 194 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:48.467681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.484677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99c57-528d-4146-8252-83012d29dabb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.511320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:48.525235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.526200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.526688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.527307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.528233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] RBAC: Adding query filter params (interface=public, service_id=4cf78da2d4cd43cda0f9e32e136765a4, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:48.528742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.530553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.541329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 381/778] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:29:48 2022] GET /identity/v3/endpoints?service_id=4cf78da2d4cd43cda0f9e32e136765a4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:48.547178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:48.677390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8972c-8380-4dac-953f-f6466d389cdb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.718228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.719510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.719998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.720740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.721597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.723195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1371bc-f508-4f9a-b1d7-8a7b2ea9f59c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.729642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 382/779] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:29:48 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:48.746179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e29fe-893d-4565-a9ff-ddc97a9b7bf9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:48.776829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:48.794272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:48.795241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.795765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.796234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.797036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:48.802921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:48.803912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd212f-9d7e-4433-87fb-a89d450a3510 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.804653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd212f-9d7e-4433-87fb-a89d450a3510 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.805490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd212f-9d7e-4433-87fb-a89d450a3510 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.807623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 383/780] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:48.813348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 398/781] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:29:48 2022] GET /identity/v3/services => generated 772 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:48.815202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c58a9-1508-40e3-8b39-d6fa9e947f65 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:48.815709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c58a9-1508-40e3-8b39-d6fa9e947f65 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:48.816230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c58a9-1508-40e3-8b39-d6fa9e947f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:48.849738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-484c58a9-1508-40e3-8b39-d6fa9e947f65 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:48.851363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-484c58a9-1508-40e3-8b39-d6fa9e947f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:48.932562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:48.969076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 384/782] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:49.273524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:49.346884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734157db-cdd0-405e-aa83-65247d510ace None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.347832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734157db-cdd0-405e-aa83-65247d510ace None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.348304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734157db-cdd0-405e-aa83-65247d510ace None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.350753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 385/783] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:49.355959 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.356472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.356944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.375595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:49.377383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:49.440946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ea35f-f5e8-47d9-acb7-df68c947c36e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:49.464934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 386/784] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:29:49.507565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:49.508202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.508485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.508756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.525829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-83083f18-4e3e-46e0-b2a9-430dcb1f266a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:49.534728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:49.535641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:49.536495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 399/785] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:49.542289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:49.551892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f79e-cd7d-4ed5-9804-bcdf606eb7f1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.552170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f79e-cd7d-4ed5-9804-bcdf606eb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.552631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09f79e-cd7d-4ed5-9804-bcdf606eb7f1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.554363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 400/786] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:49.559780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.560272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.560735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.602950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:49.604504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:49.654735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bebf0-828b-4d21-ab61-7097186ca616 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:49.670294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:49.670905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:49.696297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:49.696919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.697204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.697484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.698205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:49.698514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:49.699890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:49.714065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 387/787] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:49.715736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:49.734093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 401/788] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:29:49.763472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:49.827829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ebeee-e945-479b-bae9-718068190e5d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:49.896321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:49.896962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:49.897247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:49.897524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:49.923922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:49.925417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:49.945518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:49.946525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:49.947446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:49.947446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:49.947446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:49.951808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 388/789] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:49.953140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:49.983104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:49.990940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596088f-06a4-49ea-bad7-62c19f6d8bd3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.053110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.053773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.054089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.054371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.067185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:50.072311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.073291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:50.074138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 402/790] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:29:50.074820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.116493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.177633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fc46-aad5-4083-ab5a-cd485e977d01 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.189565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24a65-99c8-4331-a826-26115c02cd5b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.216453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.217149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.217433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.217802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.218495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:50.218794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.220258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.229158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.229794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.230106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.230448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.237011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 389/791] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:50.237998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.242148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:50.247034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.249082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 403/792] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:50.251150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.327704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.344416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddf408-8036-4911-8b3e-77396db56cce None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.356355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.363447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d3225-d3e7-4f75-8aa2-9400d9291033 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.382152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.382685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.382966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.383235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.384029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:50.384282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.385793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.395011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 390/793] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:50.396485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.403169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.404011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.404521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.404946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.412887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.414628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:50.427294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.428417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:50.429496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:50.436369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 404/794] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:50.437366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.497818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd913d-7a78-4f33-a5fc-249f86e9df0a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.534177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.534874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.535159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.535430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.536220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:50.536497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.537845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.546677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 391/795] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:50.547482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.556518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b394dc-1c72-4151-8488-8349d60730e5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.585461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.592254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.593014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.593296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.593571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.604649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.606134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:50.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.621905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:50.622818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:50.622818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.622818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:50.626757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 405/796] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:50.627875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.639638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.655446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813859-5e7c-4f75-a428-a301496e9b75 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.691341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.692924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.693352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.693767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.694695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:50.695141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.696990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.715843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 392/797] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:50.716885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.731048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3082208-2c9a-486b-860c-d4d287c0c5bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.766348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.766985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.767268 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.767544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.778465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.779922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:50.794306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.795463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:50.796555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:50.796555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.796555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:50.798453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 406/798] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:50.798742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.799441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.827529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7a49-47fd-466e-be2f-50bdbca18da7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.862159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:50.866455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.867296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.867770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.868264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.869148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:50.869645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.872357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.885819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 393/799] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:50.887136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:50.916912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb0546-f638-465d-9d32-241244d8d7ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:50.959733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:50.961132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:50.961863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:50.962388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:50.976748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:50.978606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:50.997809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:50.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:50.999684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:50.999684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:50.999684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:51.002417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 407/800] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:51.004065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.009559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48e5f-6c9d-47fe-8e84-feecbe33135b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.040066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.050644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.051253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.051538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.052356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.053034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:51.053339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.054757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.074062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 394/801] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:51.076073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.142786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccdc8e-8ce5-4a4a-bea0-c8a0f83d14e0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.160938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.190380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.190927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.191206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.191478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.201203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.203008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.213266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e12d-5cfe-4803-b286-0bb8055dd98b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:51.217765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:51.218756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:29:51.219675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:51.224281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 408/802] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:51.225657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.259562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.260490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.260779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.261145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.261698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:51.262029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.263856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.275390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 395/803] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:51.276239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.332500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.342943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b217cc6-4cf0-459e-948f-7da5f35fe4b7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.380121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.380751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.381012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.381283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.388783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.389392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee08971-e88e-4ada-bace-ae042fc08e2a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.390238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1d493feb-f6f1-4402-883f-817f67489245 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:51.401778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:51.402722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:51.403636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 409/804] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:51.404869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7849-c40f-4569-860f-872e0bfcf9e0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.404869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7849-c40f-4569-860f-872e0bfcf9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.404869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7849-c40f-4569-860f-872e0bfcf9e0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.410084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 410/805] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:51.410761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7849-c40f-4569-860f-872e0bfcf9e0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.430711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99806814-300c-43d5-94af-97f460b7539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.431335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99806814-300c-43d5-94af-97f460b7539d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.431615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99806814-300c-43d5-94af-97f460b7539d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.431886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99806814-300c-43d5-94af-97f460b7539d None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.432631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99806814-300c-43d5-94af-97f460b7539d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:51.432935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99806814-300c-43d5-94af-97f460b7539d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.434440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99806814-300c-43d5-94af-97f460b7539d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.455063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.460976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 396/806] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:51.462459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99806814-300c-43d5-94af-97f460b7539d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.533483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7849-c40f-4569-860f-872e0bfcf9e0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.561331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99806814-300c-43d5-94af-97f460b7539d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.569182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.569805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.570111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.570385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.571699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.577274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.578733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2c2a3787-6c80-468d-b894-b0251dd85f1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:51.589632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:51.590549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:51.591437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 411/807] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:51.591929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53bb9-b163-4b54-bcfa-ade282b2798f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.592290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53bb9-b163-4b54-bcfa-ade282b2798f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.592433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df53bb9-b163-4b54-bcfa-ade282b2798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.602593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.603205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.603489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.603763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.604492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:51.604803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.606246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.609753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0df53bb9-b163-4b54-bcfa-ade282b2798f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:51.610956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0df53bb9-b163-4b54-bcfa-ade282b2798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:51.623460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 397/808] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:51.624258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.681037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 412/809] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:51.682539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc025-b868-4475-a825-1bfc9e83fe3c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.682832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc025-b868-4475-a825-1bfc9e83fe3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.683106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc025-b868-4475-a825-1bfc9e83fe3c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.688653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 413/810] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:51.689426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc025-b868-4475-a825-1bfc9e83fe3c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.718148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.721584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e957a-212b-4831-b98c-1dd6872dd334 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.757859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.758490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.758769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.759039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.788384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.801011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc025-b868-4475-a825-1bfc9e83fe3c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.830666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.832265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65935b-405b-41c8-8aa7-1b1851364ca3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.839335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:51.839947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.840230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.840509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.841204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:51.841511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:51.842964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:51.855175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 414/811] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:51.860729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:51.938414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 398/812] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:29:51.938414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:51.938414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:51.938414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:51.947403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:51.953667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:51.954899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:51.966335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e61c6-072d-48ff-9a97-08a39a07ab98 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:51.999571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.000126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.000407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.000678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.011212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.012644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.013568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.027911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 399/813] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:52.027911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:52.028172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.029011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:52.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:52.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:52.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 415/814] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.135917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278014-f05d-41a1-b2c0-27629e5d2d65 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.147278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65eaa-a76e-4151-bbf9-43c125227721 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.172445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.173073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.173354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.173645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.175511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.185236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.185519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.185879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.186186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.186512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/acb5646ccfe0421591346d235e8f3cf9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.186981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.188496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=acb5646ccfe0421591346d235e8f3cf9, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.189905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:52.203186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.209738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:52.210723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:52.210723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:52.210723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.210723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 416/816] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.210723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.213688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 400/816] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:52 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/acb5646ccfe0421591346d235e8f3cf9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:52.222089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.297665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.341997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d59a-ce7c-4adc-8998-8fef1a36ddb7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.346829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f8db-1ea1-45bd-99c1-57a56c5fb5cb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.381549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.382319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.382597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.382867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.383456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.386119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.390779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.391240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.391240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.391474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.392687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:52.392687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.394979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.397730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.398762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.399588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 417/817] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.402121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.410483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 401/818] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:52.411928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.456490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.511797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82265-8bca-487f-93c1-eec7e4adb870 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.512023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda640e-e40e-4745-9f42-7132117e06bf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.526768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.548275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.548456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.548835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.548937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.549115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.549297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.549371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] PATH_INFO: `/v3/services/network` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.549438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.549983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.550159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:52.550424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.551334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.551843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.560370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.561402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:52.562281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 402/819] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.563091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.569990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 418/820] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:52.569990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.675099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767f3d-1325-42a4-8d39-afebb5308478 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.678294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b9fa-f490-4256-a124-957f46d7f53d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.689041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.714721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.715330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.715613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.715887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.716512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:52.716718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.716842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.717341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.717619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.717890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.718181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.722909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 403/821] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:52.723540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.729307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.730783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:52.742083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.742988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:52.743878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.747844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 419/822] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.748683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.769827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.830263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262662-833e-427b-ba80-133b7a2a26aa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.852096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a928e-bad3-4243-9da4-a62eead068f3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.867769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.868377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.868666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.868948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.869574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] RBAC: Adding query filter params (name=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:52.869881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.871254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.876024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 404/823] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:52.877257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.888970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:52.889916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:52.890236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:52.890508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:52.897377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:52.898862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:52.910517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:52.911589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:52.912654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:52.916449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 420/824] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:52.917348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:52.949386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:52.991282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb8498-00be-4749-9142-a10910cbaf46 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:52.998525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:53.024039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894671-d281-4b81-97f0-cb6eee3f2e58 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.026542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.027234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.027582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.027926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.028644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:53.029027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.030512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.035634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 405/825] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:53.037155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.062403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.063007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.063286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.063558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.064240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:53.064542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.066076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.078209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 421/826] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:53.084488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.142313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984e83c-bdb6-4469-bb5d-87d0c534e640 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.179557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.180160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.180440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.180710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.181328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] RBAC: Adding query filter params (type=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:53.181625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.183007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.186570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:53.188324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 406/827] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:29:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:53.188840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.204066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff76a6-cca7-485a-baae-977a3aa60e67 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.226015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:53.242818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.243485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.243768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.244190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.245054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:53.245374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.246969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.259502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 422/828] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:53.260116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.310233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55c96-521d-41a7-94d4-06308256b276 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.348882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.349587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.349830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.350134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.350798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.352159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.373977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 407/829] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:29:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:53.374804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.390930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687976fc-fd85-41a4-b417-a67319f99e3a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.448573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.450384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.450822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.451523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/0dade6dd73bb45cc9aaf0e6ac61e5c34/roles/64455ea032c24c999e904095081c7aad` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.472869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=0dade6dd73bb45cc9aaf0e6ac61e5c34, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.475938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.478041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:53.483441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:53.495893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20866bf2-9296-4773-a874-2b9f57b594da None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.502097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 423/830] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:29:53 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/0dade6dd73bb45cc9aaf0e6ac61e5c34/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:29:53.502097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:53.574836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.575452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.575734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.576008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.577054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.578504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038168b-f91a-40b1-8b6a-80d700363cab None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.610907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 408/831] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:29:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:29:53.668371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba387-7f66-4eba-a82c-c1205861819a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:53.719490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:53.720124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:53.720407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:53.720681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:53.721515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:53.721896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:53.724142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a7e6-c154-4259-b444-be3edc357ed7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:53.737142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 424/832] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:53 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:54.387786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61aee3-7376-40ef-8348-721f74bcd2ee None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:54.388137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61aee3-7376-40ef-8348-721f74bcd2ee None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:54.388340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61aee3-7376-40ef-8348-721f74bcd2ee None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:54.389918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 409/833] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:54.395326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:54.395771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:54.395938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:54.414318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:54.415490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:54.470007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:54.492832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 425/834] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:29:54.765399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61aee3-7376-40ef-8348-721f74bcd2ee None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:54.872464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61aee3-7376-40ef-8348-721f74bcd2ee None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:54.906746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:54.907386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:54.907663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:54.907935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:54.919478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:54.924327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:54.925255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:54.926104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 410/835] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:54.932252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.034923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ecca2-cfcc-49e6-81a5-62fa4cc01546 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:55.070393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:55.071044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.071324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.071591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.072243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:55.072538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:55.073974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:55.083667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 426/836] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:29:55.089289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.098502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:55.196653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834bb0-fa47-4bbd-8d58-fd54904efdb7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:55.233545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:55.234218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.234502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.234842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.247242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:55.248920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:55.264715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:55.265682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:55.266595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:55.266595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:55.266595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:55.270358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 411/837] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:55.272655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.327555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:55.383014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45e39e-6da9-471c-a1a6-e0d128be9fa1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:55.418512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:55.419160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.419382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.419660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.420308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:55.420615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:55.422010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:55.435398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 427/838] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:55.440558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.505311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:55.547627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c6de-31fa-4ff6-92ea-ad315cfb9a70 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:55.581794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:55.582374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.582820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.583093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.590859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:55.592285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bbb2ffd6-d52d-46e5-aa47-4d966516dff2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:55.604122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:55.605016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:55.605931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 412/839] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:29:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:55.611143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.726235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f13de-d62d-4311-8961-633d2a797bf9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:55.738247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:55.772373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:55.772999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.773286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.773561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.774348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:55.774657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:55.776271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876061d5-385e-4382-925b-8ab670763d8b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:55.866471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4008-e145-47e8-9964-fcac03d184d2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.867094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4008-e145-47e8-9964-fcac03d184d2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.867094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4008-e145-47e8-9964-fcac03d184d2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.868592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 413/840] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:55.874282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322b30-129a-4618-b3ec-4101c6b966d5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.874668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322b30-129a-4618-b3ec-4101c6b966d5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.874839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d322b30-129a-4618-b3ec-4101c6b966d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.894573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9d322b30-129a-4618-b3ec-4101c6b966d5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:55.896308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9d322b30-129a-4618-b3ec-4101c6b966d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:55.914221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 428/841] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 8 18:29:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:55.918626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1376eb-22e8-48ef-9634-967a31bf022e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.918626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1376eb-22e8-48ef-9634-967a31bf022e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.918626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1376eb-22e8-48ef-9634-967a31bf022e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:55.918626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 429/842] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:55.922031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1376eb-22e8-48ef-9634-967a31bf022e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:55.974370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 414/843] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:29:55.975625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58b51-9d9b-44f3-848b-14f4dee921d4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:55.975911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58b51-9d9b-44f3-848b-14f4dee921d4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:55.976181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58b51-9d9b-44f3-848b-14f4dee921d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.005874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-57e58b51-9d9b-44f3-848b-14f4dee921d4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:56.007199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-57e58b51-9d9b-44f3-848b-14f4dee921d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:56.053408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1376eb-22e8-48ef-9634-967a31bf022e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.070176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.094771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.095594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.095973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.096351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.100690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 415/844] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:56.145848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.176455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.177910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.208541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254324e-49da-49a0-a077-ec803f2fd9fc None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.208823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254324e-49da-49a0-a077-ec803f2fd9fc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.209087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254324e-49da-49a0-a077-ec803f2fd9fc None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.210693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 416/845] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:29:56.215524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.215806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.216081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.233961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:56.235210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:56.294561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 430/846] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:29:56.295637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.310750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 417/847] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:29:56.311655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.381269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.418814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6632b8-d0b1-402e-a1e7-d427f840671f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.428899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.431098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daa76c-4cb1-4f20-85dc-ea90b8c2ee14 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.456532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.457248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.457533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.458398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.466929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.467548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.467819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.468089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.468715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.470169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.478797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:29:56.483899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:56.484827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:29:56.485672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:56.486782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:56.487623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:56.488507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:56.488507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:56.488507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:56.489843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 431/848] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:56.490305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 418/849] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:56.490904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.491326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.594161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bebe3-a32e-4f4f-882b-c112c7eedcc7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.604369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdabf6f-d5c1-4e85-a665-2c26342cbd0a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.619483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.628554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.629179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.629455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.630312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.630894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.632260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.639826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.640430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.640739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:56.640858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:56.641764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:29:56.642937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:56.643652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.643652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:56.643652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.643838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 432/850] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:56.643838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.643958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.654832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 419/851] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:56.655631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.677573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.743977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488239e1-f3fd-4552-b1d1-a3f3ec48b280 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.758518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977cc2-478b-4019-9e34-b3cbce5c3121 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.776846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.777434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.777710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.778004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.778657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:56.778961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.780323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.787874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 433/852] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:56.788640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.795715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.796419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.796704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.796975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.797553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.798996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:56.808054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:56.809057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:56.809933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 420/853] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:56.810736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.842011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.888760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19e560-8428-41cc-b47e-e8506cc3ac8c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.892800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:56.908538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084baaa-d469-4460-8a60-302e2c3c592c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:56.921081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.921685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.921994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.922272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.922893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:56.923198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.924556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.929414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 434/854] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:56.930154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:56.946805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:56.947422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:56.947699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:56.947971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:56.954555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:56.955963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:56.966933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:56.967928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 421/855] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:56.974411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.028679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25e194-360e-49fb-bf27-d31c50980b58 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.044463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.062680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.063383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.063664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.063936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.068240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1e95-cdac-44cc-ad48-8697732ff3cc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.074597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.076043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:57.090186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:57.091295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:57.092376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:57.092376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:57.092376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:57.092376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 435/856] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:57.092376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.101980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.102589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.102870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.103144 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.103766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.104070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.105422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.109671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 422/857] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:29:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.110473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.121313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.199227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d7e5-19cf-480a-a45e-e6cef24f1f22 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.207210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2374-81e3-44e9-b980-bc79ff5dbe67 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.232123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.232835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.233011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.233282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.233907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.234252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.235620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.240060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.240591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 436/858] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.240718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.240923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.241193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.241362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.241874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.242206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.243626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.262426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 423/859] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.263142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.282676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.353097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.361377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1f61-e71f-4b90-9ea0-9811f046e91f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.396307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc788-be06-4446-bee6-3ec0128da8da None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.425161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.425786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.426099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.426383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.427115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.427505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.428915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.438975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.439885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.440172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.440455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.441095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.441503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 437/860] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.441963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.442796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.446752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.452530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 424/861] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.452530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.558461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.563045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2a28-6864-48a1-9f2f-e525c5aed9b4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.596822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617991e-4298-4bfc-b6e0-e38fba81a672 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.603637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.604258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.604532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.604810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.605547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=acb5646ccfe0421591346d235e8f3cf9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.605857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.607338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.623172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 438/862] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/role_assignments?user.id=acb5646ccfe0421591346d235e8f3cf9&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.636190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:57.643770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.644434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.644718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.644994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.657073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.658573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:29:57.672401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:57.673406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:29:57.674360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 425/863] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:57.680655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.811507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121366a6-350c-4e81-90cb-5c058ddce7d7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:57.849128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:57.850153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:57.850661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:57.851138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:57.852067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:57.852578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:57.854240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:57.873281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 439/864] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:57.880331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:57.982029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eb075-f523-4a24-8d61-26886eb87496 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:58.016667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:58.017280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:58.017563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:58.017842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:58.082174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:58.092958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:58.094691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:58.203461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 426/865] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:29:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:29:58.205133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:58.221404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:58.314415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9ff6-67b2-445b-8077-4499075ff3d7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:58.350903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:58.351459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:58.351742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:58.352018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:58.362749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:58.364235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:29:58.379790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:58.380724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:29:58.381630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:29:58.381630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:29:58.381630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:58.385540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 440/866] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:58.386951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:58.483508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:58.492201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72bf9-02d6-4a39-8726-3564dc84496d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:58.528625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:58.529657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:58.529965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:58.530245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:58.530890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:58.531199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:58.532565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:58.549141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 427/867] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:58.550539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:58.622295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:58.666156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ca536-ca61-45be-8f96-486750be6f68 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:58.701285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:58.702252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:58.702730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:58.703215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:58.710644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:58.712278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:29:58.723641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:29:58.724522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:29:58.725439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:29:58.727725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 441/868] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:29:58.738046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:58.848411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dcb60-883b-45fd-b39c-3330b7a1bd62 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:58.885677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:58.886242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:58.886526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:58.886802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:58.887559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:58.887867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:58.889369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff244f-a05f-49fc-b129-17f630f089e1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:58.902319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 428/869] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:58.911093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:59.018842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ad22-8334-4262-827b-b89a263fb518 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:59.045147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:59.056002 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:59.056613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.056894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.057169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.057902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:29:59.058241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:59.059674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c615-3a3a-4af6-869d-7e3ad5908f1d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:59.066215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 442/870] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:29:58 2022] GET /identity/v3/role_assignments?user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:29:59.435653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973fab-ab5d-47ca-9fa8-ba9cbdeedd7e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.436166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973fab-ab5d-47ca-9fa8-ba9cbdeedd7e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.436241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973fab-ab5d-47ca-9fa8-ba9cbdeedd7e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.437769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 429/871] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:59.442992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9371-a105-4b53-807a-7cb0858eaebc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.443280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9371-a105-4b53-807a-7cb0858eaebc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.443549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9371-a105-4b53-807a-7cb0858eaebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.461417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fffe9371-a105-4b53-807a-7cb0858eaebc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:59.462618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fffe9371-a105-4b53-807a-7cb0858eaebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:59.533013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 443/872] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:59.784802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837ff-eba6-4e39-850e-2b911697ac60 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.785063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837ff-eba6-4e39-850e-2b911697ac60 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.785337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b837ff-eba6-4e39-850e-2b911697ac60 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.787427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 430/873] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:29:59.792845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b7afe-c0ad-4f0e-8b5c-f4023bd2d8d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.793809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b7afe-c0ad-4f0e-8b5c-f4023bd2d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.794323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b7afe-c0ad-4f0e-8b5c-f4023bd2d8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.812785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-161b7afe-c0ad-4f0e-8b5c-f4023bd2d8d0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:29:59.814391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-161b7afe-c0ad-4f0e-8b5c-f4023bd2d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:29:59.815130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b837ff-eba6-4e39-850e-2b911697ac60 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:29:59.830574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:29:59.906272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 444/874] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:29:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:29:59.937236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b837ff-eba6-4e39-850e-2b911697ac60 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:29:59.972735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:29:59.973434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:29:59.973711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:29:59.973997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:29:59.974652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:29:59.976001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d38ca-0d6a-45e4-8e20-01449b7a1371 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:29:59.995924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 431/875] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:29:59 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:00.011795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4c17c-ccde-4cee-bd07-05a7f7c673b9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.012129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4c17c-ccde-4cee-bd07-05a7f7c673b9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.012355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4c17c-ccde-4cee-bd07-05a7f7c673b9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.015313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 445/876] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:00.020845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.021152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.021408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.042461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:00.043626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:00.125027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:00.144831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 432/877] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:00.198129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4c17c-ccde-4cee-bd07-05a7f7c673b9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:00.253094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:00.308365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4c17c-ccde-4cee-bd07-05a7f7c673b9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:00.344562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:00.345222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.345511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.345839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.346602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:00.347972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:00.374156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 446/878] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:00 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:00.415671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:00.527700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d82a96-83bf-4a02-9056-b74bfdf0bf41 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:00.569958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:00.570521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.570797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.571065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.571637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:00.572989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:00.581902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:00.583065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:00.584193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 433/879] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:00.589425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:00.695891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff8df-07ea-41fe-9235-d39faa2d3202 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:00.706888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:00.734060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:00.734664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.734940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.735211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.735839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:00.736136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:00.737496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae1517-23e0-44fe-9e9d-b6be46b9fb4a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:00.743392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 447/880] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:00.748841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:00.813295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:00.858797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84838-125b-4a18-9882-6ea5f5c409db None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:00.895309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:00.896277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:00.896786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:00.897323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:00.898201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:00.898739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:00.900355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec0b4-8b37-4390-a2f7-44b08a1a7c94 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:00.905692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 434/881] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:01.389571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420ee9-1ef2-49ee-8d9c-99ffe150b9d8 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:01.390094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420ee9-1ef2-49ee-8d9c-99ffe150b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:01.390195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420ee9-1ef2-49ee-8d9c-99ffe150b9d8 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:01.391728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 448/882] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:01.398569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:01.398858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:01.399134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:01.425704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:01.427464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:01.528655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 435/883] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:01.855994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420ee9-1ef2-49ee-8d9c-99ffe150b9d8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:01.988111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420ee9-1ef2-49ee-8d9c-99ffe150b9d8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.025723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.030131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.030131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.030131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.045531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:02.050521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:02.051507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:02.052320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:02.054733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 449/884] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:02.060289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.142892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.206228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc513c-34a4-4db0-a18c-947231ecc7fb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.242411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.243032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.243309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.243579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.244248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:02.244547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:02.245932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95adbf5-f56c-4739-aa6b-d85150a69da0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:02.256642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 436/885] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:02.262273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.315586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.384969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723bd60-fe7a-4d94-a1c1-6dba809e141e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.385281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723bd60-fe7a-4d94-a1c1-6dba809e141e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.385526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723bd60-fe7a-4d94-a1c1-6dba809e141e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.386256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017bdf6-a373-4a42-b76c-d58a0964f51a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.387142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 437/886] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:02.392069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.392348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.392622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.412157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:02.413756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:02.421013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.421640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.421908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.422256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.432979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:02.434503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:02.451123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:02.452169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:02.453080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:02.453080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:02.453080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:02.456089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 450/887] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:02.463459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.488822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 438/888] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:02.560716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.576645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ca82-c9dd-4dba-9cb5-a755d0e32aee None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.611415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.612047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.612329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.612602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.613264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:02.613569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:02.615660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a1b99-bf93-475f-93fe-8459949d2d35 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:02.630968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 451/889] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:02.636758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.686851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.739667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed528ee-5358-4ff4-ad3e-d030d29453f7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.739990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed528ee-5358-4ff4-ad3e-d030d29453f7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.740300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed528ee-5358-4ff4-ad3e-d030d29453f7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.745520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 452/890] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:02.745662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68929a-4187-44a5-b720-8fd756e60506 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.747084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.747372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.747647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.767087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:02.768287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:02.783981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.784618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.784902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.785176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.792547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:02.794023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:02.806306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:02.807462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 439/891] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:02.808578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.866247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 453/892] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:02.866247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:02.925795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460640-fff6-4cff-b4ba-cb1ad2187405 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.928774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.942734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:02.966491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c62e-4abc-48d7-ba5d-709d8eb08cff None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:02.976306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:02.977317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:02.977816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:02.978415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:02.979197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:02.981056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:02.992651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:02.993664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:02.994555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:02.998085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 440/893] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:03.000883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.011054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.011668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.011944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.012212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.012978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.013231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.014767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.033372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 454/894] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.038871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.134649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67aff-3736-4eec-b2bc-c5417df4ee43 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.145157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e02ee9-aedc-4beb-bbc8-ccd937de6833 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.175324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.176805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.177293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.177803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.178952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.179410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.181175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.182525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.183135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.183403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.183678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.186647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.188213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 441/895] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:03.189293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.227267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.258328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.259777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fc3e-4197-4632-aa78-d8e9c13d48df None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.297895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66988-eba2-436b-9f6f-cdbf5da60050 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.333026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.333650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.333950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.334238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.334811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.336166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:03.344644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:03.345650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:03.346588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 442/896] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:03.347491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.365446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 455/897] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 18:30:03.367728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568270a-40b6-4849-a539-27bd8fcbc306 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.368203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568270a-40b6-4849-a539-27bd8fcbc306 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.368675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568270a-40b6-4849-a539-27bd8fcbc306 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.374152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 456/898] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:03.374152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568270a-40b6-4849-a539-27bd8fcbc306 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.421158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.469131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.475695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814ef6-87bc-4de5-a9d4-5b28f2a58232 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.494759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568270a-40b6-4849-a539-27bd8fcbc306 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.507845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697486-082a-498e-a530-7f706306dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.508450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697486-082a-498e-a530-7f706306dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.508734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697486-082a-498e-a530-7f706306dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.509006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697486-082a-498e-a530-7f706306dc48 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.509625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697486-082a-498e-a530-7f706306dc48 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.509926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697486-082a-498e-a530-7f706306dc48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.511307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697486-082a-498e-a530-7f706306dc48 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.515883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 443/899] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.516654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697486-082a-498e-a530-7f706306dc48 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.532205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.532807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.533086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.533355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.533998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.534301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.535710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e21e13-af7e-4f06-966c-e6e9e3152046 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.540631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 457/900] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.541853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.542166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.542444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.559450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:03.560619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:03.615800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697486-082a-498e-a530-7f706306dc48 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.624680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 458/901] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:03.625499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.651879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.652504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.652788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.653057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.664076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.665505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.667016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:03.680238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:03.681384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:03.682311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:03.682311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:03.682311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:03.682311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 444/902] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:03.682562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.700855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.759487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6be11-0fe1-4a5c-b453-9ec0a3aa23fb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.794697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.795554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.795985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.796413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.797263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] RBAC: Adding query filter params (interface=public, service_id=3974714dce3b4d1688c38085b52f1390, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.797719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.799281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.801986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844ac6-a115-4b32-9340-de98135da830 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.808793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 459/903] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/endpoints?service_id=3974714dce3b4d1688c38085b52f1390&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.808793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.843629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.844500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.844933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.845357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.846179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.846647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.848177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.853266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 445/904] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.854721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.906206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.913828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775776-3c6b-488b-a3e6-08f93711c48d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:03.943270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:03.948313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:03.948919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:03.949199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:03.949475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:03.950143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:03.950446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:03.951816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:03.963617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 460/905] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:03.964400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:03.971088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffaa0-3284-4d9a-97cc-2709c0f3735f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.003747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.005029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.005318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.005588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.006217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.007560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.013092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 446/906] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:30:04.013980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:04.075618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0337-ddf8-4277-8a1b-2d1855f6ec1e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.119394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.120019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.120304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.120587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.121285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] RBAC: Adding query filter params (interface=public, service_id=dd0817e65ab84683b5a1edef90b3031c, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:04.121800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.123021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.128813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 461/907] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:30:03 2022] GET /identity/v3/endpoints?service_id=dd0817e65ab84683b5a1edef90b3031c&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:04.129703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:04.143990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4e10-bb0d-431f-ae96-82bff7940f37 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.150539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:04.182657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.183288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.183574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.183854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.184519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.185904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.197390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:04.205308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 447/908] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:04 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:04.206308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:04.259324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304160ac-a572-4fdd-8de6-8f750f6fa99c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.328945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.329934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.330468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.331520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.345046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.347172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.347325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067471c-9fd2-4c35-8756-e7b35c9f0b04 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:04.364727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:04.365714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:04.366654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:04.370032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 462/909] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:04.376005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:04.403603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.404227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.404511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.404786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.405404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.406816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.415581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 448/910] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:04 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:30:04.466932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:04.505930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a697-9554-4975-904a-7c0ff5ecc863 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.545978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.546989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.547479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.547957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.548883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:04.549417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.551259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e2ac7-3a35-4599-8f04-07ebf065e332 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.566336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 463/911] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:04.572881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:04.640857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:04.685027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756904-f7b4-4691-9a89-9cb98c5eb074 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:04.719496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:04.720115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:04.720391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:04.720668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:04.721402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] RBAC: Adding query filter params (role.id=8f8a01b4eaae40539efd7a2299e98e0f, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:04.721711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:04.723692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96808-ea46-4324-8d99-5754107f814f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:04.729659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 449/912] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:04 2022] GET /identity/v3/role_assignments?user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=8f8a01b4eaae40539efd7a2299e98e0f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:06.271891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200264a8-cd2e-41dc-aa33-b47e7eb43b25 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.272873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200264a8-cd2e-41dc-aa33-b47e7eb43b25 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.273369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200264a8-cd2e-41dc-aa33-b47e7eb43b25 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.275216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 464/913] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:06.280906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc009-06d2-4c19-bc73-d03398c7b42e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.280906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc009-06d2-4c19-bc73-d03398c7b42e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.280906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc009-06d2-4c19-bc73-d03398c7b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.299240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a57cc009-06d2-4c19-bc73-d03398c7b42e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:06.300535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a57cc009-06d2-4c19-bc73-d03398c7b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:06.374101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 450/914] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:06.501378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625dc0-2aef-4b97-bf84-d524bcabcb3c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.501723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625dc0-2aef-4b97-bf84-d524bcabcb3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.502306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625dc0-2aef-4b97-bf84-d524bcabcb3c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.503749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 465/915] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:06.509664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea541-e0e8-4bbb-a0bf-570c8cca7ba1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.510214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea541-e0e8-4bbb-a0bf-570c8cca7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.510709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea541-e0e8-4bbb-a0bf-570c8cca7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.529105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7fdea541-e0e8-4bbb-a0bf-570c8cca7ba1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:06.530610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7fdea541-e0e8-4bbb-a0bf-570c8cca7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:06.588152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:06.609380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 451/916] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:06.648004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625dc0-2aef-4b97-bf84-d524bcabcb3c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:06.705140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b2ae-66df-4150-b198-60557fa61237 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.705776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b2ae-66df-4150-b198-60557fa61237 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.706354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b2ae-66df-4150-b198-60557fa61237 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.708035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 452/917] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:06.713125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.713627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.714188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.732978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:06.734509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:06.754618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625dc0-2aef-4b97-bf84-d524bcabcb3c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:06.786405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:06.792974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:06.794007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.794592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.795088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.795894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:06.797626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:06.808531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:06.809528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 18:30:06.810387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:06.813121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 466/919] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:06.814022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 453/919] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:06.818868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:06.885674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:06.934766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310600-9a9b-4bab-b2e6-ba1af4cd6758 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:06.976981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:06.978485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.979198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.979661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.980733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:06.981494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:06.983091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdacbde-faa4-485d-865c-1534694feb13 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:06.990064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 467/920] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:06.991472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69b25d-3283-4bd0-9813-6ad261d976e2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:06.991962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69b25d-3283-4bd0-9813-6ad261d976e2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:06.992429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69b25d-3283-4bd0-9813-6ad261d976e2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:06.994063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 468/921] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:06.995835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69b25d-3283-4bd0-9813-6ad261d976e2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:06.995946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9d5e-94cb-4ebf-b4d9-0fa36b04fd1f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.016805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.036344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.037022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.037248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.037517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.038121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.039471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b23c19fe-e095-4ddf-8d14-74c04de5eebd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:07.048995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:07.050044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:07.050909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 454/922] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:07.051719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.051800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.052543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.068027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.071349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:07.072527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:07.115128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69b25d-3283-4bd0-9813-6ad261d976e2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.143805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 455/923] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:07.144787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.162319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.163006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.163285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.163486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.164114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.164421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.165775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.181161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 469/924] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 8 18:30:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:07.181161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.273664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2629e-ccb3-4c93-a615-261588b64cf0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.294348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.306924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d44e-efaa-4135-b7f5-f264a9da544e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.323808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.324421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.324697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.324968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.325596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.325904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.327317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.338787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 456/925] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:07.338787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.342272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.356128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.356986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.357279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.357548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.358562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.359996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:07.373033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:07.374078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 18:30:07.374999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:07.378083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 470/926] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:07.380382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.466658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d368-2f27-402b-9453-4489663f44a3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.489248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56891f4-25f8-47e1-b05c-c42697028e44 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.499899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.500504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.500779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.501051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.501704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.503346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.522826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 457/927] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:07.523736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.528717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.529326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.529610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.529885 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.530571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.530877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.532302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.538684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 471/928] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:07.539571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.568156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.597324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.649507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d206f-ce39-4111-b683-94ae3482666b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.658955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b5d8-9b20-4c1f-9ea1-153e9893ecde None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.713909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.715536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.716488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.716768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.717423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.717716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.719122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.729796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 458/929] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:07.736674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.737470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.737743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.738057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.739253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.751620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:07.756928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:07.757886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:07.758771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 472/930] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:07.759495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.864777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.870956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9774e1-c13d-40c2-8793-e1ff59b22b8b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.891988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fa612-7a35-40f7-8e25-a900a0ac6ed9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:07.904655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:07.917913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.918561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.918893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.919179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.919887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] RBAC: Adding query filter params (interface=public, service_id=256247bbae614813914894bd0368834a, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.920209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.921567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.928171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 459/931] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/endpoints?service_id=256247bbae614813914894bd0368834a&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:07.929011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:07.946767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:07.947597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:07.947878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:07.948474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:07.948789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:07.949088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:07.950538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:07.959413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 473/932] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:07.960051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.046400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa4e0-9294-42e8-9952-b51788847264 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.072824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578df004-ad9b-4ea9-a7dc-eb34f63b9a40 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.080413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.081013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.081293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.081567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.082247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:08.083074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.084423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.092478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 460/933] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:08.092478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.116330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.116866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.117147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.117416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.118094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.119457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.123260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:08.125407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 474/934] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:07 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:30:08.126207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.174764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:08.229147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289732e8-55bb-4c73-b2f0-e5a1b5f0b80c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.266509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471944-bbb7-4b88-a10d-15cdf266f8a3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.287476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.288028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.288664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.288664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.289496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.291073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.318739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.319465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.319757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.320033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.320462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 461/935] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:08.338852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.340520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:08.359383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:08.360449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:08.361324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:08.361324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:08.361324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:08.363128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 475/936] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:08.369832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.458383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:08.494112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53b8c-f7b5-460d-87ef-8b61bdbd0fe5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.528986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.529600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.529882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.530185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.530829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:08.531130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.532489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.545892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 462/937] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:08.553736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.650790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:08.669232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6180-f735-4302-a606-6e15dfb40358 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.705620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.706282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.706568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.706845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.715580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.717008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:08.729421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:08.730379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:08.731328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 476/938] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:08.738209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:08.844729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db3a-00bb-47ce-8211-b65abc454301 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:08.880117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:08.880451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:08.880732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:08.885964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:08.885964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:08.885964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:08.885964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:08.887338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:08.905420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 463/939] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:08.913854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:09.023950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b5c01-4659-4418-afa9-ba32f89ca527 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:09.059087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:09.059788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.060073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.060395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.071810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:09.073254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:09.081464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:09.089182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:09.090140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:09.091051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:09.091051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:09.091051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:09.094949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 477/940] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:09.097123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:09.212835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d089-3918-41cc-847b-a53033de11f7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:09.249968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:09.249968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.249968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.249968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.250375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:09.250445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:09.253969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:09.264761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 464/941] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:09.275795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:09.401114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9abd-1abe-47da-bf79-753ff778e9ef None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:09.437662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:09.438647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.439107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.439555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.446641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:09.448280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:09.463723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:09.464598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:09.465493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 478/942] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:09.476234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:09.570548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:09.584238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482d62-c6c9-4199-a276-62dda2e0f6c0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:09.619777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:09.620755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.621240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.621713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.622634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:09.623169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:09.624796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24b8f-c7cc-49e6-aa13-8b7e2a0a9c31 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:09.638486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 465/943] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:09.646977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:09.718930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:09.763708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945ec3-feb4-402f-89d5-64ab2bf167e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:09.799515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e15df-5e42-4e02-8525-2315cff010fe None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.799878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e15df-5e42-4e02-8525-2315cff010fe None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.800071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e15df-5e42-4e02-8525-2315cff010fe None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.800487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:09.801411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.803448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.803938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/0dade6dd73bb45cc9aaf0e6ac61e5c34/roles/8f8a01b4eaae40539efd7a2299e98e0f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.805479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 466/944] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:09.806765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=0dade6dd73bb45cc9aaf0e6ac61e5c34, role_id=8f8a01b4eaae40539efd7a2299e98e0f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:09.807100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:09.807386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:09.807655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:09.811745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:09.833825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:09.835065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:09.840018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 479/945] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:30:09 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/0dade6dd73bb45cc9aaf0e6ac61e5c34/roles/8f8a01b4eaae40539efd7a2299e98e0f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:30:09.922141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 467/946] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:10.201456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:10.308029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a22335-ac26-4a4a-9ad5-64fced4469e7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:10.329619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:10.346036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:10.346653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.346935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.347210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.347880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:10.349370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:10.352026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING keystone.server.flask.common [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 18:30:10.372222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.sql.core [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 18:30:10.372222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 18:30:10.372222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [parameters: {'id': 'd99a95f8da8349e3baf6b727b8cb965e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 18:30:10.372222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-315fa68c-39d0-4321-b2de-2f4b647491f2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d99a95f8da8349e3baf6b727b8cb965e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d99a95f8da8349e3baf6b727b8cb965e. Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:30:10.392792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 18:30:10.393681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application yield resource Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise self.value Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application session.commit() Sep 08 18:30:10.394654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.flush() Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application compat.raise_( Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 18:30:10.395634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 18:30:10.396516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:30:10.397309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [parameters: {'id': 'd99a95f8da8349e3baf6b727b8cb965e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:10.399573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:10.402066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d99a95f8da8349e3baf6b727b8cb965e. Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:10.404293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 480/947] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Sep 8 18:30:10 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:10.412591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:10.446354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:10.507084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e472-2801-4c1d-9b94-f6caae73756e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.507422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e472-2801-4c1d-9b94-f6caae73756e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.507599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e472-2801-4c1d-9b94-f6caae73756e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.507746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69138be-0c1e-4c1f-9b05-9569415ab946 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:10.513155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 481/948] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:10.519785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81643da-8a1c-4553-8d78-a10a7369a02a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.520508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81643da-8a1c-4553-8d78-a10a7369a02a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.520882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81643da-8a1c-4553-8d78-a10a7369a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.545765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b81643da-8a1c-4553-8d78-a10a7369a02a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:10.546721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:10.547370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.547713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.547835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b81643da-8a1c-4553-8d78-a10a7369a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:10.547996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.555804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:10.557231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:10.569238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:10.570365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:10.571264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 468/949] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:10.576392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:10.657968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 482/950] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:10.691767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608350e2-0d0e-4525-b5ab-b0b1c1aef0b7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:10.693286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:10.722608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ccab-e3fa-4047-b911-85bc9a7835d3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.723457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ccab-e3fa-4047-b911-85bc9a7835d3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.723707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ccab-e3fa-4047-b911-85bc9a7835d3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.725341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 483/951] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:10.730175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:10.730329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.730537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.730787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:10.730895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.731071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:10.731410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:10.732077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:10.732431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:10.733851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:10.749480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:10.750704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:10.752678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 469/952] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:10.832118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 484/953] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:10.944705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.049674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89268b2a-f6e6-4c06-8878-09b7f8840837 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.085595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.086191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.086478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.089073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.089073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.089073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:11.098566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:11.099699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.101005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 470/954] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:11.107245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.114196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.151684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:11.156094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:11.231780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a401d9-2f51-43ca-b8bf-a9edcdc341ff None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.259737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7ae8c-4adf-4d65-b4a6-a3318f8b32df None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.294998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.295618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.295899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.296172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.296806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:11.297110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.298632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.308683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 485/955] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:11.309545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.311485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.312635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.314039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.314529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.315317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.317584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:11.330590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:11.331607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:11.333074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:11.335786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 471/956] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:11.342877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.441881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:11.445313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ce1a-103e-4800-bd66-f4688e87b091 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.460369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:11.476211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffc4ff-6ec7-473a-94b0-c549ab6a051a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.490532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.491087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.491372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.491646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.492281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:11.492607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.493978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.499327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 486/957] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:11.505293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.518117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.519617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.520143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.520620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.521713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:11.522732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.524573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.534828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 472/958] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:11.539148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:11.619493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aa6c7-d791-42d0-a4ca-900564be7096 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.665877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09b4a1-c4d6-4545-8c18-e3d4e02a905f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:11.666991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.668060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.669416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.669903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.670831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.672500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ba5b1-2583-455d-8864-9a116cf45591 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.709845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 487/959] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:11.731729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:11.732414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:11.732701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:11.732977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:11.733673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:11.734008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:11.735473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d080a-dcdd-47e7-8e5e-c4037044f3d9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:11.741556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 473/960] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:12.139851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9adb2-683b-4c62-ac85-925a26a3cd3d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:12.140149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9adb2-683b-4c62-ac85-925a26a3cd3d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:12.140420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9adb2-683b-4c62-ac85-925a26a3cd3d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:12.141898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 488/961] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:12.151374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:12.151937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:12.152444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:12.170647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:12.172108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:12.181692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:12.240055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 474/962] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:12.553656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9adb2-683b-4c62-ac85-925a26a3cd3d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:12.580227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:12.692864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9adb2-683b-4c62-ac85-925a26a3cd3d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:12.733973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:12.733973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:12.733973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:12.733973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:12.749976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b4bfa2b1-42cf-4cd6-940c-46d4e6f1c534 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:12.753969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:12.754960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:12.755794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 489/963] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:12.765078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:13.066434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264d28-419f-4ee2-be49-0e2dac0500a5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:13.162722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:13.163929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:13.164216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:13.164492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:13.165173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:13.167047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:13.168149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca189-59c0-4765-a4db-fec290407682 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:13.168460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:13.168623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca189-59c0-4765-a4db-fec290407682 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:13.168764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca189-59c0-4765-a4db-fec290407682 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:13.174202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 490/964] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:13.175436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:13.175720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:13.176517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:13.206514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 475/965] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:13.207458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:13.213075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:13.215145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:13.220478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:13.339192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 491/966] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:13.504329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c01fa-8efb-464c-a75e-604b5590f525 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:13.554065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:13.554708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:13.554989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:13.555261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:13.575741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:13.577184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:13.606557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:13.607591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:13.608610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:13.608610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:13.608610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:13.617961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 476/967] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:13.621963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:13.642411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:13.701771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:13.774284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722a5ad-6d5e-4822-813f-04be7db6a7bc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:13.819347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:13.820435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:13.820946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:13.821522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:13.822455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:13.823105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:13.824703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:13.847523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 492/968] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:13.863497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:13.870316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.029518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3c88-4d9c-493f-9505-33dd1a552097 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.072243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.072851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.073138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.073431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.074060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.075510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.078004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING keystone.server.flask.common [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 18:30:14.092110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.099935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.sql.core [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 18:30:14.099935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 18:30:14.099935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [parameters: {'user_id': '59a8d19f072440c498e14be105dbdec9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 18:30:14.099935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81721) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e6a5c4c6-1f06-4d95-b5a6-537a880ebb19 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Sep 08 18:30:14.107785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:30:14.108753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application yield resource Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise self.value Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application session.commit() Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 18:30:14.109828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.flush() Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application compat.raise_( Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 18:30:14.111021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 18:30:14.112078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 18:30:14.113447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [parameters: {'user_id': '59a8d19f072440c498e14be105dbdec9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:14.114476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 18:30:14.115327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 18:30:14.116229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.123286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 477/969] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 8 18:30:13 2022] POST /identity/v3/users => generated 160 bytes in 422 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:14.125375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4750-c3de-4abd-b349-9982b21508ba None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.125892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4750-c3de-4abd-b349-9982b21508ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.126415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a4750-c3de-4abd-b349-9982b21508ba None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.135633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 478/970] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:14.135633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a4750-c3de-4abd-b349-9982b21508ba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.147695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95a070-6aed-49dd-8601-fc93abde6247 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.212703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.213867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.214731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.215166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.229766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.231388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dea2630f-5e03-4509-ae43-6f8cbe26d8c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:14.257319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:14.258399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:14.259643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 493/971] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:30:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:14.260518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.260799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.261074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.268257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a4750-c3de-4abd-b349-9982b21508ba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.279873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:14.281055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:14.291900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.308374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.309084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.309373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.309649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.317695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.319268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-af96b86e-2199-4af4-ae4d-668235c0abf8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:14.330540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:14.331640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 18:30:14.333278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:14.334042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 479/972] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:30:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:14.335291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e738ce-78fa-4c5a-92a9-b35f8238847b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.335579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e738ce-78fa-4c5a-92a9-b35f8238847b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.335851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e738ce-78fa-4c5a-92a9-b35f8238847b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.338814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 480/973] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:14.342877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e738ce-78fa-4c5a-92a9-b35f8238847b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.364365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 494/974] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:14.365303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.454138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e738ce-78fa-4c5a-92a9-b35f8238847b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.456951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.489486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.490163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.490642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.491326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.493148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:14.493674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.496308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b0c00-53a1-4df0-9099-136412295475 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.504876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7105-c4b9-4b65-b6a2-71e2838fd9d0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.516576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 481/975] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 8 18:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:14.518012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.518434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.518864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.537633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:14.539273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:14.547895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.549862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.550202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.550482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.551223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:14.551536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.552964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.572433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.589466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 495/976] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 8 18:30:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:14.590351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.628529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 482/977] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:14.636601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.741556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85cb5-eedd-41d0-8710-71465c68ad13 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.756798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df0827-4ef3-4f55-acc2-474b5fbe4ae1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:14.771964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:14.795700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.796317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.796592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.796869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.815204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:14.815819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:14.816096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:14.816367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:14.817638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.819105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.843114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 483/978] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:14 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:30:14.883750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:14.885148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:14.922932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:14.964210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.014967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 496/979] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:15.020752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.044691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.065448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582e89-4702-4f56-9eef-31c722770f4f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.104554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.105193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.105526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.105803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.106422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.107783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:15.117157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:15.118224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:15.119451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:15.122117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 484/980] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:15.124079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.138292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17622032-022a-44d9-b090-47b511d0dce0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.172912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.173963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.174623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.175004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.186841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.188283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:15.203144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:15.204163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:15.205048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:15.205048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:15.205048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:15.205048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 497/981] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:15.209792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.227745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.242163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51967d-6fdf-4549-8575-037a091781b5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.283522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.284133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.284482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.284676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.285817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.286471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.287610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.289525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.292550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 485/982] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:15.299185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.323291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e230d-59a8-47f2-ad2c-76bc4603a334 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.359400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.360299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.360773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.361048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.361688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.362018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.363406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.375927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 498/983] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:15.381703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.409980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3845f-fabc-4fa1-960b-ac312d8721bb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.448537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.449254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.449703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.449885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.450669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.450980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.452333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.458243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 486/984] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:15.463624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.482608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.493102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b28e9a-fd4e-40d7-a03c-b6d196ecf472 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.528709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.536828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.537484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.537768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.538084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.544985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.546466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:15.558346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:15.559245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:15.560124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 499/985] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:15.565077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.575815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a733176-292d-4841-9a4d-f08341cf95d6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.616550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.617161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.617500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.617709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.618454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] RBAC: Adding query filter params (interface=admin, service_id=256247bbae614813914894bd0368834a, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.618775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.620134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.629847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 487/986] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/endpoints?service_id=256247bbae614813914894bd0368834a&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:15.636518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.676738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f168-5db0-4c51-8a3c-1511e0851a33 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.712003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.712613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.712920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.713213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.713919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.714261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.715696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.725253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.730381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 500/987] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:15.736639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:15.751809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89220-79e7-44e4-8dfb-a6dd1f237848 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.794133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.794745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.795030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.795294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.795896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.796581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:15.797259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60f518-0b7e-43a4-8625-2b6a823c7ce5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.804991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 488/988] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:30:15.856578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f55bc1-f8ff-47ea-94cf-595fecd7e1f0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:15.895732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:15.896357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:15.896646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:15.896919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:15.897671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] RBAC: Adding query filter params (role.id=8f8a01b4eaae40539efd7a2299e98e0f, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:15.898010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:15.899474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eee88-c622-44bf-9f44-7c4a143e2846 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:15.913962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 501/989] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:15 2022] GET /identity/v3/role_assignments?user.id=0dade6dd73bb45cc9aaf0e6ac61e5c34&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=8f8a01b4eaae40539efd7a2299e98e0f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:17.038780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a8bb-7cc3-4d81-ba01-5960cf35b4c6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.039297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a8bb-7cc3-4d81-ba01-5960cf35b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.039401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a8bb-7cc3-4d81-ba01-5960cf35b4c6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.040797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 489/990] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:17.046091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.046518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.046827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.065660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:17.067498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:17.137881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 502/991] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:17.417114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108a8bb-7cc3-4d81-ba01-5960cf35b4c6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:17.520263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108a8bb-7cc3-4d81-ba01-5960cf35b4c6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:17.557383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:17.558043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.558328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.558601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.559184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:17.560537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:17.569423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:17.570476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:17.571335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:17.572721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 490/992] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:17.576621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:17.628484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:17.686357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80250478-f271-4749-b377-d6a5e30eb9cb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:17.734971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:17.735599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.735879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.736153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.737245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:17.737557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:17.738978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:17.748973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 503/993] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:17.750124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:17.766662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:17.857246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1ca2-1683-4ca8-a1a5-cd34591fd6fd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:17.897414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:17.898059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.898345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.898618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.899258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:17.899562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:17.900952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb0dc7-fc66-432c-9059-6d6c03f14bb4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:17.911765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 491/994] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:17.913079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:17.991904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b45c-fe32-41ab-8424-83a93cc3d5ad None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:17.992119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b45c-fe32-41ab-8424-83a93cc3d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:17.992373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b45c-fe32-41ab-8424-83a93cc3d5ad None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:17.993768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 492/995] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:17.999681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08f6f-e67c-4232-9993-0efa27bac111 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.000035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08f6f-e67c-4232-9993-0efa27bac111 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.000248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08f6f-e67c-4232-9993-0efa27bac111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.022203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e5d08f6f-e67c-4232-9993-0efa27bac111 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:18.023404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b571-b695-48f7-bd66-1bcec5a2558b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.023513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e5d08f6f-e67c-4232-9993-0efa27bac111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:18.033622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.059194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.059811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.060073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.060347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.061045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] RBAC: Adding query filter params (interface=public, service_id=e1cbdbcad0944bb19840e954ecbbc5ed, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:18.061357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.062755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.073633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 504/996] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:30:17 2022] GET /identity/v3/endpoints?service_id=e1cbdbcad0944bb19840e954ecbbc5ed&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:18.075080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.105987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 493/997] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:18.117070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61626a-dab0-4b76-8330-ea7b9c43076f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.117412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61626a-dab0-4b76-8330-ea7b9c43076f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.117737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61626a-dab0-4b76-8330-ea7b9c43076f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.120131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 494/998] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:18.124430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.124721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.124996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.132856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.145554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:18.146774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:18.188060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e5ed8-417b-4b9d-927c-84786bff75ca None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.220664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 495/999] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:18.227464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.228273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.228747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.229256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.230071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.231633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.238354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 505/1000] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:30:18.374789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.486104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813554bf-a31a-48a3-aecf-a395b1f6c9d5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.491070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.522476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.528769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.529398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.529678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.529970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.530558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.530923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.532105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:18.541276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:18.542726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:18.543734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 496/1001] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:18.548142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.605647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb00-38a4-4dc5-9edd-44e54f173f25 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.653143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.653881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.654272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.654548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] PATH_INFO: `/v3/services/image` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.655122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.656595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:18.665569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:18.666616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:18.667451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 506/1002] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:18.670251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f413-dd29-480a-a191-f8947a68cdab None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.672410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.707059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.707665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.707949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.708221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.708842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:18.709140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.710603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.717817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 497/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:18.722284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.790313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.796997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:18.802794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c71ac8-3096-4adf-84b1-0f6da5d35623 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.838549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4371ec-2b93-4b69-82ce-713743480979 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:18.841976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.842754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.843211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.843651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.844426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:18.844883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.846440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.851803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 507/1004] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:18.857363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.873746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:18.874677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:18.875102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:18.875381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:18.876006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:18.876308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:18.878186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:18.884078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 498/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:18.889932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:18.968754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b663fd6-3d1d-4cad-8d1c-3f44559b0295 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:19.002810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0dda-a63c-4564-929d-f0217c71b16a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:19.006062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:19.006669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:19.006946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:19.007216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:19.007840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] RBAC: Adding query filter params (type=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:19.008141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:19.009552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f31ce7-25d2-46e8-9856-8f7dab91f043 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:19.015478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 508/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:19.029782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:19.044381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:19.045017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:19.045299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:19.045575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:19.046313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:19.047782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00d79-aa8f-40e0-8462-5b818947fd6c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:19.065760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 499/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:20.436273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232b7f-2dab-4ec4-a95a-aa86fc867f29 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:20.436804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232b7f-2dab-4ec4-a95a-aa86fc867f29 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:20.436804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232b7f-2dab-4ec4-a95a-aa86fc867f29 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:20.438246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 509/1008] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:20.443558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:20.443948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:20.444127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:20.462021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:20.463192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:20.541068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 500/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:20.805663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7232b7f-2dab-4ec4-a95a-aa86fc867f29 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:20.835364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:20.916170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7232b7f-2dab-4ec4-a95a-aa86fc867f29 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:20.952667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:20.953300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:20.953576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:20.953844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:20.954453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:20.955810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:20.965510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:20.966682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:20.967511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 510/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:20.974371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:21.076515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377aa50-8696-4eff-96c3-799a8bdeedf7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:21.089041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:21.115835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:21.116904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.117388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.117972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.118930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:21.119456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:21.121186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e381c7-9281-4eba-a207-1af380e11902 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:21.127495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 501/1011] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:21.134169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:21.234931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49af3-5298-44aa-9011-fbcaf84f04a3 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.235301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49af3-5298-44aa-9011-fbcaf84f04a3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.235499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49af3-5298-44aa-9011-fbcaf84f04a3 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.237003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 502/1012] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:21.239714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:21.243106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffe07-6411-4e08-a7fe-f81632e7d2c4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.243400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffe07-6411-4e08-a7fe-f81632e7d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.243691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cffe07-6411-4e08-a7fe-f81632e7d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.250989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65484337-4208-4643-b2bb-23ed4b46dedb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:21.262643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-71cffe07-6411-4e08-a7fe-f81632e7d2c4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:21.263841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-71cffe07-6411-4e08-a7fe-f81632e7d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:21.289271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:21.289883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.290200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.290479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.291108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:21.291672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:21.292780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd4c4-5ef4-407c-8d4b-b2248095908e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:21.297415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 511/1013] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 8 18:30:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:21.298585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57871a9-ad25-4e28-a87f-e02b160016ec None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.298875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57871a9-ad25-4e28-a87f-e02b160016ec None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.299153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57871a9-ad25-4e28-a87f-e02b160016ec None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.300482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 512/1014] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:21.303892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57871a9-ad25-4e28-a87f-e02b160016ec None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:21.335870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 503/1015] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:21.337022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.337306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.337577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.358580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:21.359865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:21.415921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57871a9-ad25-4e28-a87f-e02b160016ec None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:21.430545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 504/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:21.450794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:21.451393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.451670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.451940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.452593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:21.453967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:21.476816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 513/1017] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:30:21.607478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:21.645636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:21.707786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:21.714326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dae10a-5274-47d5-8bab-40df6df8a439 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:21.726403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:21.765137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:21.765746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.766054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.766325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.766983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:21.768368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:21.789177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 505/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:21 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:21.837589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c1bc-a7b0-4717-88e2-343d67497908 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:21.883996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:21.884552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:21.884829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:21.885096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:21.886317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:21.887910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec596dc-eab0-454a-9b18-499662bd8a17 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:21.889702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 514/1019] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:21.898631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:22.001064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:22.012685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bebe0f-9e4a-41d9-b0fb-b7fe5cde19b8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:22.049554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:22.050215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:22.050498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:22.051373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:22.052045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:22.053473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38f58c-6222-49e3-bc07-b4bb7d5a4596 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:22.083096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 506/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:21 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:23.755316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a6d2-e88a-49cb-81bd-6f37ce0a18a5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:23.755835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a6d2-e88a-49cb-81bd-6f37ce0a18a5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:23.756016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a6d2-e88a-49cb-81bd-6f37ce0a18a5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:23.757355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 515/1021] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:23.762453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ceb-cef2-43b5-8141-1f7293abd416 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:23.762867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ceb-cef2-43b5-8141-1f7293abd416 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:23.763074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ceb-cef2-43b5-8141-1f7293abd416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:23.781816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c4859ceb-cef2-43b5-8141-1f7293abd416 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:23.783090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4859ceb-cef2-43b5-8141-1f7293abd416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:23.860090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 507/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:23.958169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7461-1d1f-42cc-bdcd-c2504b796448 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:23.958482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7461-1d1f-42cc-bdcd-c2504b796448 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:23.958732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7461-1d1f-42cc-bdcd-c2504b796448 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:23.960341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 516/1023] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:23.965348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2057c6-09bc-41f5-a39a-92565ffcb185 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:23.965642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2057c6-09bc-41f5-a39a-92565ffcb185 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:23.965918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2057c6-09bc-41f5-a39a-92565ffcb185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:23.984145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3b2057c6-09bc-41f5-a39a-92565ffcb185 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:23.985384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3b2057c6-09bc-41f5-a39a-92565ffcb185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:24.056588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 508/1024] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:24.132961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7461-1d1f-42cc-bdcd-c2504b796448 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.219568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.244365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7461-1d1f-42cc-bdcd-c2504b796448 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.290037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.290678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.290960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.291235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.302353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:24.303473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24fa1-20e0-4fd4-80de-14bcca59e8fe None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.303760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24fa1-20e0-4fd4-80de-14bcca59e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.304036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab24fa1-20e0-4fd4-80de-14bcca59e8fe None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.305356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 509/1025] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:24.307202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:24.308109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:24.309579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 517/1026] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:24.313809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.314082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.314446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.314723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.322596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.336522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:24.337716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:24.406030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 510/1027] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:24.406886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.419681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402095e-3c9e-457e-8450-b709981b631c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.454498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.455095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.455382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.455653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.456315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:24.456618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.458045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.460237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.469619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 518/1028] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:24.475461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.520682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971f40-a818-488a-a1c1-ecd9246b7310 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.549975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.555901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.556535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.556819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.557097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] PATH_INFO: `/v3/services/image` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.557731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.559077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:24.568452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:24.569475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:24.570945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 511/1029] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:24.575430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.591564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97938b4-15e6-4afb-8af9-8feb6daff96e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.628038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.629410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.629834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.630347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.640838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.642383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:24.657001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:24.658020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:24.659207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:24.659207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:24.659207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:24.659207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 519/1030] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:24.663793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.681885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec20afa-4206-43b0-bfe3-ad8c19911b34 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.715323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.715931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.716215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.716492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.716656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.717119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] RBAC: Adding query filter params (name=image) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:24.717425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.719078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.724584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 512/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:24.725394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.770798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a1d62-c535-4543-8895-e4f1da7535c2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.782962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.807029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.807637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.807957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.808191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.808828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:24.809127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.810549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.822237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 520/1032] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:24.823122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.829903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae682c-fa16-41bc-ad71-191e626da2ff None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.863817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.864443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.864730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.865004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.866151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.867574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.869155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 513/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:24.870014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.923175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739539-ed7d-4c74-be43-39b0653fc8f9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:24.934482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:24.958294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:24.958901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:24.959177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:24.959446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:24.960063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] RBAC: Adding query filter params (type=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:24.960358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:24.961708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:24.966282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 521/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:24.967030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:24.975469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0a9ec-53a9-494a-99f8-b2e608b9378b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.000928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.011250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.011882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.012162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.012433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.020457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.021875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:25.032615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:25.039341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 514/1035] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:30:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:25.040348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.067600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c1f0e-24fb-4e3d-90c2-ec8065836a48 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.102021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.102622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.102902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.103192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.103838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.105262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.128454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 522/1036] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:30:24 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:25.129312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.149127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223dac-61d4-4f76-91e0-580485cd60dd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.166689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.189206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.190118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.190437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.191093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.191499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] RBAC: Adding query filter params (interface=public, service_id=ae19e96eba7e48879813a49f953831e6, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:25.191816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.193239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.199072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 515/1037] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/endpoints?service_id=ae19e96eba7e48879813a49f953831e6&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:25.204834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.250567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589bf5-d8b4-48b8-b7eb-a53761d1d365 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.273205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.298824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.299232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.299516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.301076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.301076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:25.301076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.302932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.321337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 523/1038] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:25.328080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.337693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b49d-bdcc-40d7-9cbb-c568039e48fc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.377460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.378111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.378400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.379168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.379782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.381515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.389582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 516/1039] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:30:25.437373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.453241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8381a-0f51-439e-9d10-6b3248fad8a0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.498890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.499530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.499815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.500091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.586097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.587501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.680547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.695322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 524/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 18:30:25.701338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.807564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831014dd-6ab7-493c-84fa-57b7b1f84a01 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:25.823775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:25.843408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:25.843974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:25.844259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:25.844536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:25.855219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:25.856665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:25.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:25.873615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:25.874556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:25.874556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:25.874556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:25.878032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 517/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:25.880808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:25.992812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c8758-68f2-40f2-931b-7c39adddf4ea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:26.027777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:26.028381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:26.028663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:26.028938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:26.029578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:26.029881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:26.031278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:26.046963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 525/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:26.048525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:26.159587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e166d9-720f-43de-8b84-c8e84b9e5b25 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:26.196670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:26.197305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:26.197589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:26.197869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:26.204532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:26.206010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:26.217476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:26.218537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:26.224745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 518/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:26.226714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:26.286147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:26.340324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1ad8c-801f-4cce-a405-b58499fb8f3f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:26.374386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:26.374993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:26.375277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:26.375553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:26.376243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:26.376609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:26.378410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e291d-eb69-4064-8156-0dd29d31900b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:26.393971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 526/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:26.397217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:26.431600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:26.502842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc246-0839-4955-92eb-79ab71b2aa61 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:26.538068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:26.538677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:26.538964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:26.539239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:26.539963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] RBAC: Adding query filter params (role.id=8f8a01b4eaae40539efd7a2299e98e0f, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:26.540277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:26.541694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a61126-4ebc-40db-ba2a-8fc65f0c5188 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:26.553985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 519/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:26 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=8f8a01b4eaae40539efd7a2299e98e0f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:27.344750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7fd-1441-4087-a187-9d666af3f1e9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:27.345256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7fd-1441-4087-a187-9d666af3f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:27.345363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423e7fd-1441-4087-a187-9d666af3f1e9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:27.346788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 527/1046] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:27.352346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc8ed-2d5c-49bd-a34b-b0799c217497 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:27.352738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc8ed-2d5c-49bd-a34b-b0799c217497 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:27.352913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc8ed-2d5c-49bd-a34b-b0799c217497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:27.371744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d97fc8ed-2d5c-49bd-a34b-b0799c217497 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:27.372920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d97fc8ed-2d5c-49bd-a34b-b0799c217497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:27.441930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 520/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:27.584236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710e66-70f3-4c45-898b-fda9c25186cd None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:27.584562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710e66-70f3-4c45-898b-fda9c25186cd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:27.584813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710e66-70f3-4c45-898b-fda9c25186cd None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:27.586206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 528/1048] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:27.591399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:27.591691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:27.591968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:27.611350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:27.612531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:27.630210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:27.684432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 521/1049] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:27.707561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7710e66-70f3-4c45-898b-fda9c25186cd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:27.812260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7710e66-70f3-4c45-898b-fda9c25186cd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:27.822147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:27.848324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:27.848881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:27.849158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:27.849425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:27.859356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:27.864076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:27.864992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:27.865870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:27.870169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 529/1050] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:27.871412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:27.951103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:27.978388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82ceb4-abeb-47ef-9398-0a0dfa567a96 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.020914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.021528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.021815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.022129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.022783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:28.023091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.024456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.032800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 522/1051] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:28.038507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.054583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.056599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba56ab-a3f7-45d7-8eb1-46e4daf6b03a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.092294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.092921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.093200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.093468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.094083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.095450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:28.104362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:28.105345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 18:30:28.106250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:28.110093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 530/1052] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 8 18:30:27 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:28.111681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.144385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.155241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc4069-7e1e-4c9b-8841-371ebacb0b6d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.195546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.196204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.196488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.196762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] PATH_INFO: `/v3/users/0e875e81fbca449ea047c1151f9c35f1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.214742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] RBAC: Authorizing `identity:get_user(user_id=0e875e81fbca449ea047c1151f9c35f1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.216196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.218137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 523/1053] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/users/0e875e81fbca449ea047c1151f9c35f1 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:28.223570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.226841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541975e5-ddec-4e5e-a082-11691a2a75a7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.263720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.264329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.264608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.264879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.265529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:28.265829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.267224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.272188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 531/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:28.277780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.306888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.345269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9c82-4dc9-404c-bb33-a40d95647edf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.376407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.384020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10953f-653f-415b-ac53-78c41c1e4e83 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.384143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.384689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.384965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.385232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.419174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.419783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.420070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.420341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.421923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:28.421923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.422662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.428646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 532/1055] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:28.434078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.461637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.463124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.541688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.550661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf05d08-3cff-4ef9-95d2-df190b9bb9f4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.578453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 524/1056] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 18:30:28.584760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.601436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.602115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.602399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.602680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.603379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.604757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9c827-3767-4895-82d2-1ccd818ac125 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.632959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 533/1057] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:30:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:30:28.695382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef24c-f9ac-4e2d-bbcb-cb2fa9e0d6cf None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.695668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef24c-f9ac-4e2d-bbcb-cb2fa9e0d6cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.695942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef24c-f9ac-4e2d-bbcb-cb2fa9e0d6cf None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.697343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 534/1058] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:28.703564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.703821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.704094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.725061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc07dc-0d1a-4341-a1c9-36a6a260bac8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.725341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:28.726591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:28.739889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.795351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.796025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.796302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.796569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.797772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.799299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.802525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 525/1059] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:28.808628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:28.850037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 535/1060] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:28.859138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:28.931683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e9db-21df-46cc-85d2-ab7bf4031862 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:28.971197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:28.971868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:28.972246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:28.973235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:28.974145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=3fbe350b597747318a38c34fc34ac4a3, user.id=0e875e81fbca449ea047c1151f9c35f1) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:28.974556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:28.976145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:28.986881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 526/1061] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:28 2022] GET /identity/v3/role_assignments?user.id=0e875e81fbca449ea047c1151f9c35f1&scope.project.id=3fbe350b597747318a38c34fc34ac4a3&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:29.123834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:29.274042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a2ac9-5098-41db-a80b-d01e9fc486dd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:29.317967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:29.317967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:29.317967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:29.317967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:29.329863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:29.335840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:29.336769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:29.337622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 536/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:29.343851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:29.465083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f1ede-8452-4703-8a96-8e173debbf4a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:29.468380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:29.504666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:29.505444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:29.505820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:29.506212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:29.506989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:29.507387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:29.508861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:29.523525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 527/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:29.525031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:29.534575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:29.654582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6597-7e3e-406e-bdd4-722e8006dbae None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:29.689877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:29.690534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:29.690812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:29.691116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:29.702166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:29.705795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:29.719405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:29.720386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:29.721319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:29.721319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:29.721319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:29.726036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 537/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:29.729966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:29.855485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7019-a513-49fe-b9a5-a9cd2174a800 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:29.890899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:29.893963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:29.893963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:29.893963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:29.893963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:29.893963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:29.895298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:29.917975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 528/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:29.918289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:29.979008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:30.027494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d64b7-cd06-4929-8348-eeab62e6cd47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:30.061619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:30.062289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.062568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.062841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.071291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:30.072729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:30.084859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:30.085813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:30.087328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:30.092110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 538/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:30:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:30.092235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:30.119828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:30.206657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce41e7-0955-40ef-a29a-50bd84e8e4e9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:30.245972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:30.245972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.245972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.245972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.246409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:30.246409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:30.249669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:30.275392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 529/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:30:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:30.282983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:30.409528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01bccf-e5e8-4e54-ba4c-beea246ec92c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:30.430074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:30.455988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:30.455988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.455988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.455988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.469569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:30.471405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:30.487704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:30.489286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:30.490667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:30.490667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:30.490667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:30.492478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 539/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:30.498310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:30.609604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:30.633536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fd4da-450f-43bc-aac7-ca5f1c28720a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:30.672583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:30.673196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.673477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.673784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.674654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:30.674960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:30.676845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:30.694266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 530/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:30.695267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:30.811751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27bc48-ae6f-4402-b2cb-1fa91d1467ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:30.849167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:30.849799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.850101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.850374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.857618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:30.859184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4b917c5f-50fe-4942-87c7-045c315323b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:30.871705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:30.872665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:30.873565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:30.878066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 540/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:30.879303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:30.894249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70115-8e39-421e-aae6-569884d82365 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.894565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70115-8e39-421e-aae6-569884d82365 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.894968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70115-8e39-421e-aae6-569884d82365 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.896127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 541/1071] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:30.901999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:30.901999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:30.901999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:30.921390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:30.922649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:30.953635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.003550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985838-d0d0-4af4-b608-c8aae356e632 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:31.010207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 542/1072] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:31.046054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:31.046660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.046939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.047207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.047892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:31.048193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:31.049597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc6b2-0ac3-4070-951a-256cede941e7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:31.059919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.063475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 531/1073] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:31.069379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.186262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf10ca9-8633-4b37-8459-49b67fadfb97 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:31.214490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f81ba-763f-4c45-ac2d-4be2d8aa7821 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.214812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f81ba-763f-4c45-ac2d-4be2d8aa7821 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.215045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f81ba-763f-4c45-ac2d-4be2d8aa7821 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.220296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 532/1074] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:31.221484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.221771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.222116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.225539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:31.226503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.227015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.227494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/8f8a01b4eaae40539efd7a2299e98e0f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.230136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=b1c4541fb9874e818b90fba97a1fdb20, role_id=8f8a01b4eaae40539efd7a2299e98e0f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:31.231792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:31.243585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:31.244778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:31.254808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 543/1075] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:30:31 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/b1c4541fb9874e818b90fba97a1fdb20/roles/8f8a01b4eaae40539efd7a2299e98e0f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:30:31.297344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.329595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.356917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 533/1076] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:31.424106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c4c2-dd01-42bd-97b5-966de6ed3991 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:31.467695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:31.468258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.468542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.468809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.544774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:31.546329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:31.568935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.639787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.663775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 544/1077] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:31.670025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.775576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bd253-8f1f-4c98-81f3-1549ac8d5942 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:31.804840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cededd-e940-437d-85df-50293b4adf81 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:31.805521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.812525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:31.813247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.813622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.814028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.825394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:31.830771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:31.832329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:31.833207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:31.833858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:31.834271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 534/1078] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:31.840874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.855557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:31.856461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:31.856888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:31.857579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:31.873047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:31.874999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:31.895126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:31.896205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:31.897115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:31.897115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:31.897115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:31.898093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 545/1079] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:31.903394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:31.969541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7e36-9d7f-4ad5-903c-8fbe73ed0d9d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:32.013840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:32.014586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:32.014900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:32.015425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:32.016397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:32.016673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:32.018192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:32.033851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 535/1080] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:32.035775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:32.042541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ec0a-b849-4057-855e-76ae62ec7af0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:32.088700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:32.089406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:32.090013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:32.090141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:32.091029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:32.091415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:32.093016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:32.104721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:32.114503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 546/1081] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:32.163876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d934e8-c584-4c86-b357-7f1943708b41 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:32.206457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:32.207769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:32.208050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:32.208324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] PATH_INFO: `/v3/users/0e875e81fbca449ea047c1151f9c35f1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:32.209527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=0e875e81fbca449ea047c1151f9c35f1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:32.211204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:32.213035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 536/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:32 2022] GET /identity/v3/users/0e875e81fbca449ea047c1151f9c35f1 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:32.221131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:32.261594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:32.365299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aed62-415f-4b15-badc-c242c3f8dccd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:32.411840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:32.412489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:32.412777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:32.413053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:32.415020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:32.415677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01dac-8d9b-4258-8d32-1a68abd40c2b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:32.417610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 547/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:32 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:32.427489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:32.542043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816a83-2041-44f6-8b3d-c83991c8fbc9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:32.563119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:32.577886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:32.578599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:32.578877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:32.579148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3/users/0e875e81fbca449ea047c1151f9c35f1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:32.581026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fbe350b597747318a38c34fc34ac4a3, user_id=0e875e81fbca449ea047c1151f9c35f1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:32.583102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e14e2-7c97-403a-8f85-f7db4663d2d1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:32.598296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 537/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:30:32 2022] PUT /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3/users/0e875e81fbca449ea047c1151f9c35f1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:30:33.482424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac568c-db07-4118-9ba9-6ce745d2812f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:33.482968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac568c-db07-4118-9ba9-6ce745d2812f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:33.482968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac568c-db07-4118-9ba9-6ce745d2812f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:33.484350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 548/1085] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:33.490956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:33.491471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:33.491576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:33.510711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:33.511899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:33.580432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 538/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:33.849405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac568c-db07-4118-9ba9-6ce745d2812f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:33.954548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:33.960109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac568c-db07-4118-9ba9-6ce745d2812f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:33.995157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:33.995793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:33.996079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:33.996352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.009572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:34.014664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:34.015636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:34.019080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 549/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 8 18:30:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:34.022875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.131747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9c9ad-c7c9-4788-9df6-6c6d5165618e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:34.146528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:34.173371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:34.173885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.174211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.174482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.175140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:34.175956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:34.177308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:34.190399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 539/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:34.192369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.299359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28f384-4bad-40c8-aafe-fb2bdd7b735e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:34.336095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:34.336695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.336945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.337219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.348100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:34.349574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:34.365042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:34.366030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:34.367312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:34.367312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:34.367312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:34.367312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 550/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:34.372109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.482711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d74e9-527c-4fc5-87aa-920c309d32d9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:34.526022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:34.526636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.526915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.527236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.529733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:34.530108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:34.531492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:34.544421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 540/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:34.550126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.566430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:34.661614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872564-bbb2-46ff-a824-be646d6e2e77 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:34.700982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:34.701623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.701907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.702272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.710629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:34.712132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-82515521-c46e-424f-8cf0-12a509d23c52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:30:34.726055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:34.727253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:34.728377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 551/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:34.733536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.765847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:34.793538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89bf3-9abf-42e0-8158-3cf07429b7be None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.793814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89bf3-9abf-42e0-8158-3cf07429b7be None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.794195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89bf3-9abf-42e0-8158-3cf07429b7be None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.795738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 552/1092] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:30:34.801432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.801708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.802010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.822492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:34.823688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:34.849882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd57a7-6021-4e09-90e8-38d51ec437bc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:34.888105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:34.888757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:34.889042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:34.889320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:34.890101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:34.890388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:34.891848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:34.902504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 553/1093] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:30:34.911612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 541/1094] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:34.916732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:34.919295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.024086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcde9-e660-4406-9fea-1af48b84cef1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.059086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.060055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.060355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.060625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.132510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.134017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.135996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.187318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.246773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 554/1095] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:35.255122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.292975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.305208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a00efa-d8d6-4842-a30a-a10c1bc4f1ed None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.345275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.346250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.346406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.346684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.360703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:35.365552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:35.366524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:35.367362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 542/1096] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:35.372666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.376172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677289e-302c-4e00-924f-ca5f48ac1831 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.378039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.416693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.417441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.417803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.418175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.428757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.430302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:30:35.446020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:35.446995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:30:35.448486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:30:35.448486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:30:35.448486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:35.448486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 555/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:35.453833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.509099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840936-252d-490f-9fd1-e3a22239d6c0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.546595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.547906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.548399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.548674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.549453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:35.549757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.551261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.561034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 543/1098] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:35.567179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.580153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdd883-f967-4e4c-a104-07601d788d53 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.584161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.619755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.620367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.620643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.620911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.621549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:35.621851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.623320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.636797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 556/1099] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:35.642391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.659321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.680649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed06d9-1380-40d3-81c5-231ac7c1f87a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.717283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.717913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.718259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.718897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] PATH_INFO: `/v3/users/0e875e81fbca449ea047c1151f9c35f1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.719656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] RBAC: Authorizing `identity:get_user(user_id=0e875e81fbca449ea047c1151f9c35f1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.721165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.722808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 544/1100] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/users/0e875e81fbca449ea047c1151f9c35f1 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:35.728559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.756088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340c7a-1145-4fa1-8010-bf28d207f3fa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.794120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.794574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.794856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.795126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.804481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.805867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:30:35.819964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:35.820935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:30:35.821820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:30:35.823134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 557/1101] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:30:35.823261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.827008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:35.843287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca83168-94c8-4919-855f-539f15fdfc18 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.880326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.880970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.881254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.881525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.913158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:35.940699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0db3-ee4f-44e9-9e96-e23349395c5f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:35.957292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.958892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.979036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:35.979745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:35.980097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:35.980447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:35.981209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:35.981783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:35.983345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:35.996404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 558/1102] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:36.002541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:36.046182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:36.069733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 545/1103] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:36.075262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:36.112551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ab14c-6063-4b72-930a-42a17b49278f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:36.151360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:36.151976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:36.152257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:36.152531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:36.153266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] RBAC: Adding query filter params (role.id=8f8a01b4eaae40539efd7a2299e98e0f, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=b1c4541fb9874e818b90fba97a1fdb20) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:36.153575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:36.155447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:36.157369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:36.163912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 559/1104] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:36 2022] GET /identity/v3/role_assignments?user.id=b1c4541fb9874e818b90fba97a1fdb20&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=8f8a01b4eaae40539efd7a2299e98e0f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:30:36.187047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9547ba-5d4a-493a-ade2-eb255810c928 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:36.227896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:36.228724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:36.229014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:36.229291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:36.230518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:36.231963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793749-b3c6-4408-a3d4-72865e3e4e06 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:36.239406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 546/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:36 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:36.240585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:36.365582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd8d6-fa6c-4ed0-8654-53e0bac88108 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:36.403201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:36.403813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:36.404095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:36.404370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:36.405095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=3fbe350b597747318a38c34fc34ac4a3, user.id=0e875e81fbca449ea047c1151f9c35f1) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:36.405401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:36.406928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bd3c-b5a8-4157-a431-104c86cfccbe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:36.414899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 560/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:36 2022] GET /identity/v3/role_assignments?user.id=0e875e81fbca449ea047c1151f9c35f1&scope.project.id=3fbe350b597747318a38c34fc34ac4a3&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:38.613522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c332aa-39a0-4469-b5d9-6ed31accf2bf None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:38.614077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c332aa-39a0-4469-b5d9-6ed31accf2bf None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:38.614077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c332aa-39a0-4469-b5d9-6ed31accf2bf None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:38.615383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 547/1107] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:38.620783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:38.621203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:38.621330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:38.639970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:38.641150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:38.695926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:38.706232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 561/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:38.981562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c332aa-39a0-4469-b5d9-6ed31accf2bf None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:39.037538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:39.087401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c332aa-39a0-4469-b5d9-6ed31accf2bf None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:39.120016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:39.120625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:39.120903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:39.121174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:39.122277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:39.123693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc231dc-53b6-447b-b3b3-5924432ee7e7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:39.125226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 548/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:39.131318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:39.227451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adc001-5a9a-4712-a2c8-1d3a485256fb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:39.261292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:39.261830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:39.262139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:39.262415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:39.263065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:39.264485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a494e-d74e-4289-9b5e-043b67517056 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:39.286996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 562/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:30:39 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:41.485284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dead3f-44d9-447d-b0f7-91efd0c94586 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:41.485805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dead3f-44d9-447d-b0f7-91efd0c94586 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:41.485805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dead3f-44d9-447d-b0f7-91efd0c94586 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:41.487174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 549/1111] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:41.492999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:41.493382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:41.493558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:41.511492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:41.512675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:41.555081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:41.578547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 563/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:41.849835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dead3f-44d9-447d-b0f7-91efd0c94586 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:41.947457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dead3f-44d9-447d-b0f7-91efd0c94586 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:41.963552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:41.980476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:41.981095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:41.981373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:41.981643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] PATH_INFO: `/v3/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:41.983027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] RBAC: Authorizing `identity:get_role(role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:41.984375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:41.985665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 550/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:41 2022] GET /identity/v3/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:41.991548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:42.090345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a031c-92bd-46f3-ae81-73512d55f58e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:42.123192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:42.123761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:42.124046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:42.124323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] PATH_INFO: `/v3/users/b0debaef29824e0fb8928a12d1ceba40` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:42.137758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=b0debaef29824e0fb8928a12d1ceba40)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:42.139228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:42.140817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 564/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:41 2022] GET /identity/v3/users/b0debaef29824e0fb8928a12d1ceba40 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:42.147177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:42.249095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-5542-41ad-9b86-a81a44541202 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:42.283173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:42.283774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:42.284053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:42.284323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:42.333917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:42.348897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:42.350367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:42.446460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 551/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:42.452375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:42.486656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:42.550852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82e71-e0f6-4937-97b9-2d3d8cee3ef5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:42.585915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:42.586559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:42.586835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:42.587105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:42.588192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:42.589623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10f7b1-bc6e-43a7-ae98-f8b0c8c5b9b3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:42.591256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 565/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:42 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:42.598107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:42.677336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:42.693530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3101b-a179-4742-a2cb-a308c31864c7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:42.725988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:42.726535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:42.726818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:42.727093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:42.727802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=3fbe350b597747318a38c34fc34ac4a3, user.id=b0debaef29824e0fb8928a12d1ceba40) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:42.728113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:42.729522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31c841-8402-43a6-91d9-2b363e1ba40d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:42.734692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 552/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:42 2022] GET /identity/v3/role_assignments?user.id=b0debaef29824e0fb8928a12d1ceba40&scope.project.id=3fbe350b597747318a38c34fc34ac4a3&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:44.859282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481220a0-dca5-4035-b124-473ee488d162 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:44.859810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481220a0-dca5-4035-b124-473ee488d162 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:44.859810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481220a0-dca5-4035-b124-473ee488d162 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:44.861144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 566/1118] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:44.866917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:44.867335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:44.867468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:44.886091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:44.887274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:44.951051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 553/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:45.217440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481220a0-dca5-4035-b124-473ee488d162 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:45.316306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481220a0-dca5-4035-b124-473ee488d162 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:45.318666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:45.350233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:45.350859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:45.351143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:45.351417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] PATH_INFO: `/v3/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:45.352802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] RBAC: Authorizing `identity:get_role(role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:45.354191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:45.355501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 567/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:45 2022] GET /identity/v3/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:45.361430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:45.435433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:45.455808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ada9-a081-4a02-8564-4077c3befcb9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:45.488874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:45.489429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:45.489707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:45.489998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] PATH_INFO: `/v3/users/b0debaef29824e0fb8928a12d1ceba40` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:45.491089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] RBAC: Authorizing `identity:get_user(user_id=b0debaef29824e0fb8928a12d1ceba40)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:45.492495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:45.494044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 554/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:45 2022] GET /identity/v3/users/b0debaef29824e0fb8928a12d1ceba40 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:45.499675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:45.603441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3edd-fb66-43b8-9478-93fc8d4bc37e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:45.636947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:45.637562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:45.637844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:45.638150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:45.639250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:45.640671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc494f9d-259f-45e5-a083-b3f47d30dec6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:45.642300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 568/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:45 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:45.648296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:45.744796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05164da-b9ee-47e0-aa37-6a27f0868350 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:45.777421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:45.778086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:45.778364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:45.778631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3/users/b0debaef29824e0fb8928a12d1ceba40/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:45.780686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fbe350b597747318a38c34fc34ac4a3, user_id=b0debaef29824e0fb8928a12d1ceba40, role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:45.782178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67969e-5f10-444a-a6af-fe5880e26e81 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:45.794521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 555/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:30:45 2022] PUT /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3/users/b0debaef29824e0fb8928a12d1ceba40/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:30:47.899161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8b6d-b694-40b3-9154-5bc24c730b57 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:47.899683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8b6d-b694-40b3-9154-5bc24c730b57 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:47.899683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8b6d-b694-40b3-9154-5bc24c730b57 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:47.901053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 569/1124] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:47.906335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:47.906739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:47.906884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:47.919465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:47.924894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:47.927329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:47.990924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 556/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:48.256261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8b6d-b694-40b3-9154-5bc24c730b57 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:48.298771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:48.357874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8b6d-b694-40b3-9154-5bc24c730b57 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:48.390279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:48.390892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:48.391169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:48.391440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] PATH_INFO: `/v3/roles/ea1bbbaba2514259a59398a9399aaa51` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:48.392803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] RBAC: Authorizing `identity:get_role(role_id=ea1bbbaba2514259a59398a9399aaa51)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:48.394663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:48.395944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 570/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:48 2022] GET /identity/v3/roles/ea1bbbaba2514259a59398a9399aaa51 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:48.401652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:48.499128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f754-b03a-4da8-bd17-cd7f7451ca2b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:48.532721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:48.533273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:48.533552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:48.533822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] PATH_INFO: `/v3/users/b0debaef29824e0fb8928a12d1ceba40` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:48.535597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] RBAC: Authorizing `identity:get_user(user_id=b0debaef29824e0fb8928a12d1ceba40)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:48.536997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:48.538564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 557/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:48 2022] GET /identity/v3/users/b0debaef29824e0fb8928a12d1ceba40 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:48.544375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:48.640118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17703b-9c6c-497f-9d25-2cf73a8cf1df None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:48.649430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:48.673782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:48.674408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:48.674687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:48.674956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:48.738638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:48.740062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:48.833959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 571/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:48.839660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:48.843317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:48.933714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c0c66-4309-453a-bae8-6fd0fedb4a9d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:48.967366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:48.967974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:48.968250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:48.968517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] PATH_INFO: `/v3/projects/3fbe350b597747318a38c34fc34ac4a3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:48.969597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbe350b597747318a38c34fc34ac4a3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:48.971029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee4e09-7beb-4c72-8253-eadf8e66edb1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:48.972648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 558/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:48 2022] GET /identity/v3/projects/3fbe350b597747318a38c34fc34ac4a3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:48.978786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:48.988712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:49.074653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff59d9-0b0a-47e2-a03a-a0e4a776812a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:49.107661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:49.108187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:49.108462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:49.108730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:49.109440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] RBAC: Adding query filter params (role.id=ea1bbbaba2514259a59398a9399aaa51, scope.project.id=3fbe350b597747318a38c34fc34ac4a3, user.id=b0debaef29824e0fb8928a12d1ceba40) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:49.109745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:49.111178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632c57e-9c24-4e4c-b06d-89fda37d87fc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:49.117163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 572/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:48 2022] GET /identity/v3/role_assignments?user.id=b0debaef29824e0fb8928a12d1ceba40&scope.project.id=3fbe350b597747318a38c34fc34ac4a3&role.id=ea1bbbaba2514259a59398a9399aaa51 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:51.262200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f821c-6451-41c9-bbad-abc87a400ef2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:51.262753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f821c-6451-41c9-bbad-abc87a400ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:51.262753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f821c-6451-41c9-bbad-abc87a400ef2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:51.264054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 559/1131] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:51.269459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:51.269855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:51.270049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:51.288589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:51.289765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:51.354402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 573/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:51.622903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f821c-6451-41c9-bbad-abc87a400ef2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:51.691183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:51.720037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f821c-6451-41c9-bbad-abc87a400ef2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:51.751524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:51.752136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:51.752422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:51.752956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:51.754568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:51.755974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7ec66-2cf6-4911-9e46-1871d5922930 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:51.757481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 560/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:51.763169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:51.765305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:51.860554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6c2ff-4b59-4447-9278-93d095205501 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:51.893625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:51.894802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:51.895081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:51.895352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:51.895990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:51.897411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f350f51-bb54-448d-8b0a-da0b9a2c2a0e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:51.922810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 574/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:30:51 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:54.059647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f56b1-2d4e-4398-ba92-5f4ea6356a59 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:54.060233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f56b1-2d4e-4398-ba92-5f4ea6356a59 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:54.060233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f56b1-2d4e-4398-ba92-5f4ea6356a59 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:54.061505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 561/1135] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:54.067241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:54.067608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:54.067784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:54.086084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:54.087255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:54.134873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:54.153814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 575/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:54.419226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f56b1-2d4e-4398-ba92-5f4ea6356a59 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:54.518717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f56b1-2d4e-4398-ba92-5f4ea6356a59 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:54.550839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:54.551461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:54.551741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:54.552011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:54.553113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:54.554560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365acbf-f6b0-4cd5-8e36-b10de074bbb9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:54.556098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 562/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:30:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:54.562095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:54.659082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c739a71-52dd-463f-8c98-050c0d1b4dd3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:54.693698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:54.694261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:54.694540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:54.694808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:54.695448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:54.696879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183d25-3ed7-412a-8b9a-5a5004f5595b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:54.717266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 576/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:30:54 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:30:56.905312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96244076-b411-4bb9-9343-e3fa203229b6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:56.905882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96244076-b411-4bb9-9343-e3fa203229b6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:56.905882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96244076-b411-4bb9-9343-e3fa203229b6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:56.907214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 563/1139] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:30:56.912398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:56.912797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:56.912943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:56.931082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:30:56.932247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:30:56.965232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:56.998430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 577/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:30:57.267310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96244076-b411-4bb9-9343-e3fa203229b6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:57.278732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:57.366121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96244076-b411-4bb9-9343-e3fa203229b6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:57.398189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:57.398800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:57.399076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:57.399344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:57.408885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:30:57.413619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:30:57.414733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:30:57.415760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 564/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:30:57.420808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:57.518013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b0fda-49b2-4e3b-94d4-462f80ca308b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:57.553020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:57.553612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:57.553887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:57.554180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:57.554832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:57.555128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:57.556486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:57.564370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 578/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:57.570386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:57.634641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:57.667244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a01207-8c77-4897-8aad-f1fc96502950 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:57.699073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:57.699678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:57.699957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:57.700229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] PATH_INFO: `/v3/users/1f07a521b2f0455f890491de6c2cedf0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:57.713711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] RBAC: Authorizing `identity:get_user(user_id=1f07a521b2f0455f890491de6c2cedf0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:57.715161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:57.716700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 565/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:30:57 2022] GET /identity/v3/users/1f07a521b2f0455f890491de6c2cedf0 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:57.722476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:57.753551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:57.821185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8230-edbe-4615-bb1f-229746e37386 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:57.853545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:57.854186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:57.854472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:57.854748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:57.921403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:57.922875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:57.951548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:58.018500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 579/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:30:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:30:58.025084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:58.119951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bab6-f813-4f95-8574-5d2e6f57c310 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:58.145067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:58.153488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:58.154142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:58.154423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:58.154693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] PATH_INFO: `/v3/projects/1ac0a9d19f814b5ca7ffc02964972439` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:58.155784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] RBAC: Authorizing `identity:get_project(project_id=1ac0a9d19f814b5ca7ffc02964972439)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:58.157206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2169d2-fbda-47f2-8d50-bf345713b20b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:58.158854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 566/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:30:58 2022] GET /identity/v3/projects/1ac0a9d19f814b5ca7ffc02964972439 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:30:58.165004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:30:58.261329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c62cf-f10c-4171-98ff-f21016eb31f5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:30:58.290332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:30:58.295908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:30:58.296507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:30:58.296788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:30:58.297060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:30:58.297777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=1ac0a9d19f814b5ca7ffc02964972439, user.id=1f07a521b2f0455f890491de6c2cedf0) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:30:58.298116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:30:58.299539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad62474-2129-4cc4-b940-1e7ae45593c7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:30:58.305324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 580/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:30:58 2022] GET /identity/v3/role_assignments?user.id=1f07a521b2f0455f890491de6c2cedf0&scope.project.id=1ac0a9d19f814b5ca7ffc02964972439&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:00.391469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7cad-45b6-45ce-ba7b-aadbffdf823e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:00.391987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7cad-45b6-45ce-ba7b-aadbffdf823e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:00.391987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7cad-45b6-45ce-ba7b-aadbffdf823e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:00.393335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 567/1147] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:00.398370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:00.398741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:00.398908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:00.416481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:00.417643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:00.482051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 581/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:00.747980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d7cad-45b6-45ce-ba7b-aadbffdf823e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:00.845035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d7cad-45b6-45ce-ba7b-aadbffdf823e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:00.879549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:00.880162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:00.880440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:00.880710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:00.890371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:31:00.895074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:00.896181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:31:00.897246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 568/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:00.902315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:00.997755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eb467-140b-4ddb-9df1-ff5a47aeb6a8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:01.022387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:01.030972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:01.031564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:01.031841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:01.032110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:01.032756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:01.033055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:01.034950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:01.042718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 582/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:31:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:01.048408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:01.102335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:01.149492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927e95-dab9-4bd2-a813-29b91f0409d5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:01.185395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:01.186044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:01.186328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:01.186601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] PATH_INFO: `/v3/users/1f07a521b2f0455f890491de6c2cedf0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:01.187698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] RBAC: Authorizing `identity:get_user(user_id=1f07a521b2f0455f890491de6c2cedf0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:01.189119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:01.190750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 569/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:31:01 2022] GET /identity/v3/users/1f07a521b2f0455f890491de6c2cedf0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:31:01.196594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:01.294904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510081ab-06a6-4f88-a7b8-f326a18e2fc1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:01.326906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:01.327527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:01.327797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:01.328066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] PATH_INFO: `/v3/projects/1ac0a9d19f814b5ca7ffc02964972439` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:01.329153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] RBAC: Authorizing `identity:get_project(project_id=1ac0a9d19f814b5ca7ffc02964972439)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:01.330613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df38da-41b3-449f-9c8d-af98a31bfed8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:01.332700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 583/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:31:01 2022] GET /identity/v3/projects/1ac0a9d19f814b5ca7ffc02964972439 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:01.338592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:01.443424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfceed0-36b6-4b0c-98d9-223038325e04 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:01.465501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:01.476835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:01.477480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:01.477765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:01.478073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] PATH_INFO: `/v3/projects/1ac0a9d19f814b5ca7ffc02964972439/users/1f07a521b2f0455f890491de6c2cedf0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:01.479924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ac0a9d19f814b5ca7ffc02964972439, user_id=1f07a521b2f0455f890491de6c2cedf0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:01.481342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cccd28-12d9-4558-a1d6-5f4d48f10219 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:01.493798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 570/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:31:01 2022] PUT /identity/v3/projects/1ac0a9d19f814b5ca7ffc02964972439/users/1f07a521b2f0455f890491de6c2cedf0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:31:03.586664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9128c-a2d7-4715-98e2-22a6eb2c813f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:03.587195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9128c-a2d7-4715-98e2-22a6eb2c813f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:03.587195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9128c-a2d7-4715-98e2-22a6eb2c813f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:03.588445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 584/1154] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:03.593577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:03.594009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:03.594167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:03.612490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:03.613700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:03.677952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 571/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:03.950387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9128c-a2d7-4715-98e2-22a6eb2c813f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.006154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:04.048715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9128c-a2d7-4715-98e2-22a6eb2c813f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.080472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.081078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.081898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.082190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.092285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:31:04.096984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:04.098188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:31:04.099255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 585/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:04.103882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.202486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca89b3-c823-4746-83a0-7635526dde21 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.215004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:04.236031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.236635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.236917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.237192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.238390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:04.238695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:04.240056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:04.247733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 572/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:31:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:04.254525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.351351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887cb5-5100-4b78-87c3-aece6f99a329 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.367254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:04.385675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.386337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.386624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.386903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] PATH_INFO: `/v3/users/1f07a521b2f0455f890491de6c2cedf0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.388017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] RBAC: Authorizing `identity:get_user(user_id=1f07a521b2f0455f890491de6c2cedf0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:04.389453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:04.391052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 586/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:31:04 2022] GET /identity/v3/users/1f07a521b2f0455f890491de6c2cedf0 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:04.396765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.493887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5babe-b7c9-4d7a-9b59-9c8424cae8a0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.526872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.527468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.527748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.528019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.569759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:04.594643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:04.596075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:04.689168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 573/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:31:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:31:04.695673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.792890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19955fa-9d65-4da9-8155-0e1b13181aec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.825526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.826160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.826443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.826715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] PATH_INFO: `/v3/projects/1ac0a9d19f814b5ca7ffc02964972439` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.827813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] RBAC: Authorizing `identity:get_project(project_id=1ac0a9d19f814b5ca7ffc02964972439)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:04.829231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bb8c3-daf8-4b22-bfba-7f470609d60d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:04.830833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 587/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:31:04 2022] GET /identity/v3/projects/1ac0a9d19f814b5ca7ffc02964972439 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:04.837308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:04.912345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:04.936760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a940f61-bf3b-49f7-bd68-bb3da82a6972 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:04.969550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:04.970170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:04.970454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:04.970728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:04.971446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=1ac0a9d19f814b5ca7ffc02964972439, user.id=1f07a521b2f0455f890491de6c2cedf0) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:04.971781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:04.973196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12240b7a-aa36-495a-9277-0bd61a3e7367 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:04.978748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 574/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:31:04 2022] GET /identity/v3/role_assignments?user.id=1f07a521b2f0455f890491de6c2cedf0&scope.project.id=1ac0a9d19f814b5ca7ffc02964972439&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:07.120443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf406c6-8a08-4011-bd7e-179e39756920 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:07.121001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf406c6-8a08-4011-bd7e-179e39756920 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:07.121001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf406c6-8a08-4011-bd7e-179e39756920 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:07.122321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 588/1162] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:07.127410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:07.127820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:07.128226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:07.146604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:07.147787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:07.210951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 575/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:07.482583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf406c6-8a08-4011-bd7e-179e39756920 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:07.535655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:07.582545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf406c6-8a08-4011-bd7e-179e39756920 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:07.615104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:07.615691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:07.615970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:07.616239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:07.681717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:07.683180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:07.732295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:07.778215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 589/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:31:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:31:07.784090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:07.848389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:07.880429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08ae8-fc9c-4545-ae61-7d4b8c920d38 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:07.913699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:07.914330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:07.914608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:07.914878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:07.921190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:07.922629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6509b9dd-416d-41cc-8e45-63283d812132 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:07.933474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:07.934792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:31:07.935786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 576/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:31:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:07.940416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:08.035465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb1af1-5935-4c6d-a0d8-10ab7caa5d40 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:08.067290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:08.067874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:08.068151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:08.068420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:08.069049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:08.069348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:08.070713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107b78-fa6d-4bf1-80a4-fb0da3e173fc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:08.077489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 590/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 8 18:31:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:10.160701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdbbe-51c9-4e14-ad43-c8cf75eb8c6a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:10.161233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdbbe-51c9-4e14-ad43-c8cf75eb8c6a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:10.161233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdbbe-51c9-4e14-ad43-c8cf75eb8c6a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:10.162616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 577/1167] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:10.167920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c31cd-fc30-4efd-8d9b-2685c67c5522 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:10.168327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c31cd-fc30-4efd-8d9b-2685c67c5522 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:10.168463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c31cd-fc30-4efd-8d9b-2685c67c5522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:10.186633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fd4c31cd-fc30-4efd-8d9b-2685c67c5522 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:10.187794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fd4c31cd-fc30-4efd-8d9b-2685c67c5522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:10.198777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:10.252482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 591/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:10.515895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdbbe-51c9-4e14-ad43-c8cf75eb8c6a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:10.613773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdbbe-51c9-4e14-ad43-c8cf75eb8c6a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:10.638662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:10.646695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:10.647289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:10.647566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:10.647837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:10.648511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:10.649836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522228d-10bf-4947-b204-585de8817db6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:10.664626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 578/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Sep 8 18:31:10 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:31:12.794134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2c2f-d0c0-4639-b222-cdcacf0f2604 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:12.794678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2c2f-d0c0-4639-b222-cdcacf0f2604 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:12.794678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb2c2f-d0c0-4639-b222-cdcacf0f2604 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:12.796008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 592/1170] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:12.801690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:12.802115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:12.802254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:12.819864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:12.821038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:12.895380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 579/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:31:13.165207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb2c2f-d0c0-4639-b222-cdcacf0f2604 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:13.264326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb2c2f-d0c0-4639-b222-cdcacf0f2604 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:13.297964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:13.298582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:13.298865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:13.299141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] PATH_INFO: `/v3/domains/4e49cb30e7f5412787da898a257e4542` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:13.309153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e49cb30e7f5412787da898a257e4542)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:13.310620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0a7d-9961-43f1-bb2e-f535d23d9961 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:13.312180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 593/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Sep 8 18:31:13 2022] GET /identity/v3/domains/4e49cb30e7f5412787da898a257e4542 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:13.318204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:13.412284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da5000-9ff7-41d7-a70b-3bd90570bd3b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:13.428532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:13.446059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:13.446657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:13.446938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:13.447211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:13.447861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:13.449273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10e5e-c302-4a39-8cdf-2d0ccaaf22fa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:13.475571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 580/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:31:13 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:31:15.656289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754dd0-299a-4a84-a06d-75cc32fdb9bc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:15.656780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754dd0-299a-4a84-a06d-75cc32fdb9bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:15.656780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754dd0-299a-4a84-a06d-75cc32fdb9bc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:15.658123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 594/1174] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:15.664030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:15.664443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:15.664573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:15.682229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:15.683398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:15.746333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 581/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:31:16.021780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754dd0-299a-4a84-a06d-75cc32fdb9bc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:16.031138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:16.121850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754dd0-299a-4a84-a06d-75cc32fdb9bc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:16.155363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:16.155983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:16.156261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:16.156530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] PATH_INFO: `/v3/domains/4e49cb30e7f5412787da898a257e4542` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:16.157627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e49cb30e7f5412787da898a257e4542)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:16.159119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cceb7d-c933-4f36-a105-9d34dc1a30fe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:16.160646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 595/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Sep 8 18:31:16 2022] GET /identity/v3/domains/4e49cb30e7f5412787da898a257e4542 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:16.166380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:16.265439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:16.268577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9788-70c8-4913-894b-02ba005184d4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:16.304122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:16.304722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:16.305004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:16.305276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:16.305927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:16.307381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1e912-a822-4370-bc5b-ce12a7b12542 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:16.328440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 582/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:31:16 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:31:18.513617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579633-8d1d-48dc-839c-7e34fe501cca None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:18.514178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579633-8d1d-48dc-839c-7e34fe501cca None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:18.514178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579633-8d1d-48dc-839c-7e34fe501cca None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:18.515495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 596/1178] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:18.521257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:18.521673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:18.521802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:18.540124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:18.541237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:18.604701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 583/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:18.876348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579633-8d1d-48dc-839c-7e34fe501cca None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:18.951192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:18.976945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579633-8d1d-48dc-839c-7e34fe501cca None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.009741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.010384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.010665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.010937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.022795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:31:19.027583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:19.028666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:31:19.029862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 597/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:19.034698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:19.115424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:19.131055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b3f4-1abf-4952-ae8f-1148d2c9ca35 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.165707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.166351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.166636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.166913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.167576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:19.167884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:19.169264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:19.184947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 584/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:19.191657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:19.287855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0fb47-994c-4aa7-8ce6-daf3c677f63a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.321077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.321696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.322006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.322283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] PATH_INFO: `/v3/users/2dd0a86001ae4e3cbce729acffc60350` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.324107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:19.336246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] RBAC: Authorizing `identity:get_user(user_id=2dd0a86001ae4e3cbce729acffc60350)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:19.337675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:19.339291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 598/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:31:19 2022] GET /identity/v3/users/2dd0a86001ae4e3cbce729acffc60350 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:31:19.345022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:19.441194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66b15-06c7-4be9-9913-0e45b6a214b4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.473035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.473626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.473908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.474215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.491373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:19.539108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:19.540540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:19.634610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 585/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:31:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:31:19.640515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:19.736155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db40b-f28c-4d54-abc5-32045a86315b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.769177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.769779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.770091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.770364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] PATH_INFO: `/v3/projects/dab523bbd17e4e2eb2956c98628353eb` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.771457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] RBAC: Authorizing `identity:get_project(project_id=dab523bbd17e4e2eb2956c98628353eb)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:19.772868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb244eb-cd00-4963-9b18-83b2fc4e829b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:19.774467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 599/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:31:19 2022] GET /identity/v3/projects/dab523bbd17e4e2eb2956c98628353eb => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:19.780332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:19.826262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:19.874652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39b7d1-9a2d-4dcd-ac63-8a0806b86967 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:19.907010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:19.907602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:19.907879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:19.908147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:19.908854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=dab523bbd17e4e2eb2956c98628353eb, user.id=2dd0a86001ae4e3cbce729acffc60350) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:19.909159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:19.910587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9803-7498-49ff-b7b8-fdf62a5abb16 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:19.915658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 586/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:31:19 2022] GET /identity/v3/role_assignments?user.id=2dd0a86001ae4e3cbce729acffc60350&scope.project.id=dab523bbd17e4e2eb2956c98628353eb&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:22.025601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1568e-ba12-4924-adb2-7cfa2b32e1a9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.026160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1568e-ba12-4924-adb2-7cfa2b32e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.026160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1568e-ba12-4924-adb2-7cfa2b32e1a9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.027490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 600/1186] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:22.032660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.033045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.033216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.051602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:22.052774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:22.117115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 587/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:22.384050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1568e-ba12-4924-adb2-7cfa2b32e1a9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:22.442734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:22.483256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1568e-ba12-4924-adb2-7cfa2b32e1a9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:22.516237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:22.516850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.517133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.517409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.527208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:31:22.531946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:22.533075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:31:22.534883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 601/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:22.539558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:22.580205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:22.633917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5ca1a-a294-4128-8785-e759cb5f9e75 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:22.666169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:22.666759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.667042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.667314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.667965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:22.668266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:22.669618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:22.677857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 588/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:22.684029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:22.780682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8515b-548a-4312-b6ac-599fb32e2bd5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:22.800072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:22.814369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:22.814984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.815757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.816071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] PATH_INFO: `/v3/users/2dd0a86001ae4e3cbce729acffc60350` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.817192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] RBAC: Authorizing `identity:get_user(user_id=2dd0a86001ae4e3cbce729acffc60350)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:22.818664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:22.820205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 602/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:31:22 2022] GET /identity/v3/users/2dd0a86001ae4e3cbce729acffc60350 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:22.825807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:22.921490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67266f-fff0-47fb-aec4-1ee8089ea30c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:22.923712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:22.954795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:22.955405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:22.955685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:22.955961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] PATH_INFO: `/v3/projects/dab523bbd17e4e2eb2956c98628353eb` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:22.957049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] RBAC: Authorizing `identity:get_project(project_id=dab523bbd17e4e2eb2956c98628353eb)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:22.958497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c198a-6a4f-436c-a2c8-881dc0cb80aa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:22.960077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 589/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:31:22 2022] GET /identity/v3/projects/dab523bbd17e4e2eb2956c98628353eb => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:22.965781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:23.062999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf94c6-3088-46cc-8303-2a9f7698b907 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:23.096511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:23.097146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:23.097429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:23.097706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] PATH_INFO: `/v3/projects/dab523bbd17e4e2eb2956c98628353eb/users/2dd0a86001ae4e3cbce729acffc60350/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:23.099610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] RBAC: Authorizing `identity:create_grant(project_id=dab523bbd17e4e2eb2956c98628353eb, user_id=2dd0a86001ae4e3cbce729acffc60350, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:23.101024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf844675-ed1c-4721-bd2f-2bd5aa0a3844 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:23.113624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 603/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:31:22 2022] PUT /identity/v3/projects/dab523bbd17e4e2eb2956c98628353eb/users/2dd0a86001ae4e3cbce729acffc60350/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:31:25.239930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2379-f1e7-4eb4-ac80-367a63c4244d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:25.240458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2379-f1e7-4eb4-ac80-367a63c4244d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:25.240458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2379-f1e7-4eb4-ac80-367a63c4244d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:25.241802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 590/1193] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:31:25.246967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:25.247328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:25.247528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:25.265996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:31:25.267238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:31:25.309679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:25.332844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 604/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:31:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:31:25.599784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a2379-f1e7-4eb4-ac80-367a63c4244d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:25.696926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a2379-f1e7-4eb4-ac80-367a63c4244d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:25.728921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:25.729525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:25.729808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:25.730122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:25.740350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:31:25.745083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:31:25.746189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:31:25.747309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 591/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:31:25.751890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:25.847546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2118-e9c1-4a20-aa70-46287d0db854 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:25.881036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:25.881566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:25.881845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:25.882140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:25.882787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:25.883084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:25.884430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:25.892164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 605/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:25.898039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:25.928753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:26.000233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1bb9-1778-49e8-b540-6645ec83083c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:26.033519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:26.034741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:26.035021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:26.035289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] PATH_INFO: `/v3/users/2dd0a86001ae4e3cbce729acffc60350` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:26.036380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=2dd0a86001ae4e3cbce729acffc60350)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:26.037800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:26.039374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 592/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 8 18:31:25 2022] GET /identity/v3/users/2dd0a86001ae4e3cbce729acffc60350 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:26.045171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:26.087130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:26.144312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9ed4-664c-4569-bb74-0e5b6a5b18f6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:26.177230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:26.177830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:26.178135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:26.178406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:26.242113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:26.243539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:26.283019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:26.339712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 606/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:31:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:31:26.345543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:26.438552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:26.442018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c7ca-bffe-445a-91ee-b36ad9f09ad1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:26.474903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:26.475525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:26.475804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:26.476076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] PATH_INFO: `/v3/projects/dab523bbd17e4e2eb2956c98628353eb` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:26.477171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] RBAC: Authorizing `identity:get_project(project_id=dab523bbd17e4e2eb2956c98628353eb)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:26.478613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93035e14-234a-441a-9f9e-304611625b49 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:26.480211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 593/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 8 18:31:26 2022] GET /identity/v3/projects/dab523bbd17e4e2eb2956c98628353eb => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:26.486286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:31:26.582280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382a664-b274-4bd3-be8f-c12fae3adea9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:31:26.615082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:31:26.615670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:31:26.615948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:31:26.616218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:31:26.616934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=dab523bbd17e4e2eb2956c98628353eb, user.id=2dd0a86001ae4e3cbce729acffc60350) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:31:26.617237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:31:26.618678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ab97-4db8-4511-9418-cef48d461d30 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:31:26.624217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 607/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:31:26 2022] GET /identity/v3/role_assignments?user.id=2dd0a86001ae4e3cbce729acffc60350&scope.project.id=dab523bbd17e4e2eb2956c98628353eb&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:31:36.471158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=16 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:31:36.621766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:22.269284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16724-155e-4b07-920f-1547b1315687 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:22.269863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16724-155e-4b07-920f-1547b1315687 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:22.269863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b16724-155e-4b07-920f-1547b1315687 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:22.271245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 594/1201] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:22.276839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:22.277704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:22.278252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:22.304782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:22.306326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:22.397977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 608/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:22.685604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b16724-155e-4b07-920f-1547b1315687 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:22.836472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b16724-155e-4b07-920f-1547b1315687 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:22.885363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:22.886185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:22.886544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:22.886822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:22.898496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:22.899960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:22.918270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:22.919618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:22.920875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:22.920875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:22.920875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:22.920875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 595/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:22.928870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:23.052532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46568f-ecaa-45e1-a8de-bf9a65c2216b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:23.089733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:23.097146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:23.097821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:23.098095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:23.098371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:23.099228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:23.099455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:23.100948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52429e-cb4d-49cb-a030-3e936a259244 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:23.120041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 609/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:23.126351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:23.201335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:23.280063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c132d3-0a82-4d9b-9a8f-cfe8a78cb11e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:23.325707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:23.326381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:23.326673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:23.326939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:23.327622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:23.329039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c9bf4-dcf9-4ce2-99ca-20fe94a76975 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:23.360937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 596/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 8 18:32:23 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:32:25.750253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5994-f542-4633-8fca-da727c69ac97 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:25.750827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5994-f542-4633-8fca-da727c69ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:25.750827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5994-f542-4633-8fca-da727c69ac97 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:25.752301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 610/1206] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:25.760072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:25.760618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:25.760618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:25.780849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:25.782173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:25.860893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 597/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:26.162056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b5994-f542-4633-8fca-da727c69ac97 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:26.296080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b5994-f542-4633-8fca-da727c69ac97 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:26.339430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:26.340133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:26.340480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:26.340758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:26.354129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:26.359984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:26.360963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:26.361798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 611/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:32:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:26.368664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:26.416165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:26.486770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753b062-d07d-4e1d-ba36-efc210a15e80 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:26.530363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:26.530986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:26.531276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:26.531556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:26.532291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:26.532616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:26.534552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:26.543788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 598/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:32:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:26.550489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:26.610472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:26.671917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6866-629a-46ba-a7c4-f30353ed7923 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:26.717344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:26.718130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:26.718416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:26.718688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:26.731967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:26.733612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:26.755804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:26.757337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:26.758284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:26.758284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:26.758284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:26.758284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 612/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:26.763478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:26.887490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:26.892119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c93-a6b0-4e6d-9758-3aacf2f1a329 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:26.941765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:26.942378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:26.942655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:26.942930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:26.943569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:26.943956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:26.945380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:26.964682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 599/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:26.965538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:27.075511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28464-de7e-407a-83cc-7b48224959ad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:27.077104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:27.116949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:27.118028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:27.118462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:27.118924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:27.129277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:27.131041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:27.141904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:27.142884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:27.144494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 613/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:27.150195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:27.272308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22a90-890c-4c0f-842c-5b60bce2150c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:27.312895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:27.314213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:27.314816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:27.316101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:27.317240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:27.317848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:27.319831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:27.347133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 600/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:32:27.349173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:27.464957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34ebd4-e921-4287-bdfb-8d57c801b0df None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:27.502279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:27.503763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:27.504090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:27.504361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:27.537873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:27.581034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:27.582612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:27.691251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 614/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:32:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:32:27.697679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:27.718716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:27.822699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81392a-f767-4862-b2f0-33605b7c8200 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:27.874057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:27.874837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:27.875188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:27.875537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:27.891040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:27.892962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:27.913387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:27.915076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:27.916347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:27.916347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:27.916347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:27.916347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 601/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:27.922103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:27.996236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:28.038436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f596-875b-4374-bb61-6eed25e9b768 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:28.074342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:28.074949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:28.075216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:28.075490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:28.076277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:28.076583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:28.078072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:28.090119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 615/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:32:28.095841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:28.174834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:28.210875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae06c-0976-4757-99af-fe9562a42a33 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:28.250898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:28.251669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:28.252039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:28.252330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:28.260059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:28.261748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:28.274452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:28.275764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:28.277058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 602/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:28.281850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:28.397914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648d839-5162-4685-ac6d-bf89969cc3ec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:28.424815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:28.439256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:28.439986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:28.440837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:28.441123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:28.441915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:28.442279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:28.444121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943bf5c-eaeb-4666-8019-9cac0402d8a8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:28.457582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 616/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:28.463907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:28.585245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9bcf-5fda-4150-a8fd-c88b6e8c0709 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:28.617111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:28.625275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:28.625884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:28.626189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:28.626466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:28.627187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=e477d29670604652952616a8600d11cf) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:28.627496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:28.629478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22aefe-48f1-4ad9-83e5-735338e9059c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:28.635786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 603/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:32:28 2022] GET /identity/v3/role_assignments?user.id=e477d29670604652952616a8600d11cf&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:30.858668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5e62-221d-42aa-b00e-aef43415b96b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:30.859239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5e62-221d-42aa-b00e-aef43415b96b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:30.859239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5e62-221d-42aa-b00e-aef43415b96b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:30.860535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 617/1220] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:32:30.866419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:30.866850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:30.866953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:30.885586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:30.886790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:30.962591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 604/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:31.228976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5e62-221d-42aa-b00e-aef43415b96b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:31.351094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5e62-221d-42aa-b00e-aef43415b96b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:31.387492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:31.388148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:31.388430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:31.388703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:31.399707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:31.404633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:31.405584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:31.406799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 618/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:31.412701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:31.528172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a4ac2-5121-4ac6-90a4-c9978d2dc7eb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:31.552861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:31.564467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:31.565116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:31.565920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:31.566211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:31.566860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:31.567198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:31.568514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:31.576720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 605/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:31.582973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:31.625822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:31.689491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0bce-b976-4596-ace9-3dce9e910c44 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:31.725326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:31.725989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:31.726250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:31.726516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:31.737394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:31.738986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:31.753508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:31.754859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:31.756243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:31.756243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:31.756243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:31.756243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 619/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:31.762528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:31.874938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156bf95-0187-4449-bcef-51cc438aa03f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:31.917700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:31.918490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:31.918784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:31.919066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:31.919873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:31.920241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:31.922022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:31.936750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 606/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:32:31.943951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.049390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:32.058519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc19e-0328-46b7-8096-7fbe6d8b6529 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:32.096875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:32.097504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:32.097788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:32.098099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:32.106661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:32.108210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:32.121165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:32.122506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:32.123721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 620/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:32.129170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.183296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:32.243820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466a7f0-59ca-4229-81c4-d16237e190f7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:32.287708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:32.288322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:32.288601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:32.288875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:32.289602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:32.289934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:32.291475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:32.309889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 607/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:32.315753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.432522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1edd37-7aa4-4906-a3a2-e9f5968025c9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:32.468204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:32.468925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:32.469207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:32.469505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:32.481658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:32.483129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:32.499244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:32.500418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:32.501517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:32.501517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:32.501517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:32.501517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 621/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:32.506517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.619580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddcde-c017-469e-8b7b-dfd6968a93c6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:32.622113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:32.659127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:32.660397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:32.660677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:32.660946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:32.661577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:32.661875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:32.663244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:32.674345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 608/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:32.680534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.690150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:32.786199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106fb2-9cc9-4471-b4cf-b56023f02b7d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:32.820881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:32.821519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:32.821825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:32.822139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:32.829083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:32.830607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:32.842979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:32.844257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:32.845246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 622/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:32.851391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:32.963117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d63a-9719-4591-b46e-02e29c1f9891 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:33.001540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:33.002208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:33.002483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:33.002740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:33.004006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:33.004319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:33.006028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ab34d-9c07-4755-917f-2dfc83617ac7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:33.024212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 609/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:33.030302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:33.103617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:33.142732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093772-5a56-441d-a3b5-d6d02229eeba None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:33.176674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:33.177329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:33.177608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:33.177880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/e477d29670604652952616a8600d11cf/roles/64455ea032c24c999e904095081c7aad` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:33.192440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=e477d29670604652952616a8600d11cf, role_id=64455ea032c24c999e904095081c7aad)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:33.193871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cfa7f-65e3-4ae1-9c3a-007c35c701b8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:33.209192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 623/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:32:33 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/e477d29670604652952616a8600d11cf/roles/64455ea032c24c999e904095081c7aad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:32:35.553014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7b8-a592-4321-b943-91a7704befe9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:35.553014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7b8-a592-4321-b943-91a7704befe9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:35.553014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192c7b8-a592-4321-b943-91a7704befe9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:35.553014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 610/1233] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:35.558464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:35.558911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:35.559010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:35.578546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:35.579957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:35.655023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 624/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:35.958574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c7b8-a592-4321-b943-91a7704befe9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:35.985357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:36.074895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192c7b8-a592-4321-b943-91a7704befe9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:36.111509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:36.112152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:36.112429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:36.112701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:36.124676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:36.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:36.132029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:36.132972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 611/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 8 18:32:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:36.138599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:36.194791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:36.260604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f8f6-3ed3-4e94-9c41-4019211a29b1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:36.306307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:36.306916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:36.307199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:36.307469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:36.308130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:36.308430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:36.309822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:36.318262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 625/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 8 18:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:36.324226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:36.419511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:36.436691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcdf7-c031-4676-88b2-f8e25cabd682 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:36.472171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:36.473064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:36.473346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:36.473621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:36.485322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:36.486788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:36.502883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:36.504412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:36.505343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:36.505343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:36.505343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:36.505343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 612/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:36.511423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:36.624916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6c846-4f68-473e-9c25-004549a688e3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:36.635431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:36.663563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:36.664283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:36.664568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:36.664882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:36.665514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:36.665900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:36.667431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:36.680631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 626/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:32:36.686867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:36.795207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268260-81ae-4893-8ca8-78bb0c7b0c74 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:36.830575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:36.831168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:36.831448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:36.831722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:36.834392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:36.840442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:36.842198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:36.854423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:36.855517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:36.857035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 613/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:36.862971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:36.974761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0490-3dd9-4827-99ed-8f79c06b042d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:37.010486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:37.011082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:37.011346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:37.011620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:37.012439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:37.012638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:37.014101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:37.031683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 627/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:32:37.038118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:37.152804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294eed2-a82a-4da7-8794-4b49e48a3996 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:37.191237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:37.191839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:37.192135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:37.192393 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:37.263878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:37.273355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:37.274889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:37.395396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 614/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:32:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 18:32:37.401258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:37.433604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:37.515904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8186247-8a7d-4877-a45e-e68b85d85650 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:37.555211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:37.555840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:37.556114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:37.556382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:37.569104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:37.570834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:37.587898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:37.589174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:37.590262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:37.590262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:37.590262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:37.590262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 628/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:37.595904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:37.699032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:37.704933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52457-a12a-438c-96de-cd8080b0dd90 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:37.740272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:37.740879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:37.741155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:37.741422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:37.742085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:37.742409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:37.743827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:37.760664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 615/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:37.761820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:37.843368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:37.875284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e735b-8e75-451c-9da6-b9aa4f61e14c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:37.915388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:37.916015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:37.916293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:37.916567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:37.924169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:37.926150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:37.938539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:37.939635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:37.941238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 629/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:37.946956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:38.057574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83073e97-cb71-4dbb-9a7d-3b09ea9fadf6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:38.094652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:38.095271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:38.095598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:38.095842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:38.096501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:38.096828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:38.098250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde33b-fe66-4fc9-af74-c8be332ea67a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:38.111890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 616/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:38.119020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:38.229913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6a4b-9d05-4313-8ffd-6e4acce4dce0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:38.265742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:38.266381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:38.266670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:38.266964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:38.267706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] RBAC: Adding query filter params (role.id=64455ea032c24c999e904095081c7aad, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=e477d29670604652952616a8600d11cf) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:38.268014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:38.269470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab172-fce6-4489-a350-55ac5af1c75f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:38.275713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 630/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:32:38 2022] GET /identity/v3/role_assignments?user.id=e477d29670604652952616a8600d11cf&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=64455ea032c24c999e904095081c7aad => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:40.509549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a35cc-529c-45b6-a4bf-dacb426ce472 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:40.510224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a35cc-529c-45b6-a4bf-dacb426ce472 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:40.510224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a35cc-529c-45b6-a4bf-dacb426ce472 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:40.511463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 617/1247] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:40.517302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:40.517767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:40.517848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:40.524796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:40.539297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:40.540505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:40.614858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 631/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:32:40.884902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a35cc-529c-45b6-a4bf-dacb426ce472 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:40.904182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:40.999481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a35cc-529c-45b6-a4bf-dacb426ce472 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.037462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.038125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.038407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.038677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.049096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:41.054528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:41.056081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:41.057311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 618/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:41.061767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:41.165871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86743da9-7864-47b9-a55f-2c057d8d5fef None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.198046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:41.204365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.204979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.205262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.205538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.206264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:41.206567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:41.207929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:41.216936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 632/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:41.223864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:41.309248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:41.332501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2e45-1a54-4eef-85b7-f1290bf4f89f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.370304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.370930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.371239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.371477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.382360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:41.383788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:41.398337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:41.400243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:41.402139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:41.402139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:41.402139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:41.402139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 619/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:41.405711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:41.516978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf58-9a66-410c-89eb-31702fb49ec7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.562035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.562764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.562908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.563188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.564069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:41.564492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:41.566447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:41.580775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 633/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:41.587186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:41.698753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e1ee-7036-4edc-bf95-ca71a551c51d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.727160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:41.735288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.735939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.736222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.736497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.745061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:41.746579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:41.758868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:41.760062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:41.766381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 620/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:41.767148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:41.825551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:41.881910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fcf9b-cb43-4b6b-9857-a84ecc4618b2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:41.919380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:41.919999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:41.920276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:41.920544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:41.921284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:41.921588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:41.923092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:41.942643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 634/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:41.948508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.056080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dc2a-97ae-4934-aef4-bd2e6cd9bc37 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:42.089772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:42.090407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:42.090690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:42.090967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:42.146661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:42.159942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:42.161397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:42.258514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 621/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:32:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:32:42.264251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.360424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda328-8b16-4c0b-a3b8-77844d23f5bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:42.373350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:42.394535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:42.395144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:42.395421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:42.395690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:42.405226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:42.406670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:42.420609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:42.421706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:42.422974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:42.422974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:42.422974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:42.422974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 635/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:42.427828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.512069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:42.523980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c8a0-4537-4e96-b65b-56355dc3fd24 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:42.556801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:42.557400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:42.557681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:42.557975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:42.558613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:42.558913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:42.560268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:42.571772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 622/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:42.577570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.673827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6158d9-77c8-44d2-aa0c-a5bf3ea236fa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:42.706641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:42.707248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:42.707522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:42.707790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:42.714195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:42.715609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:42.726797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:42.727865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:42.728963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 636/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:42.733760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.828780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003a19-9f63-45bc-bba2-f71712abead7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:42.868404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:42.869112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:42.869460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:42.869850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:42.870741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:42.871151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:42.873003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0042c9-5fe4-46bd-891b-daefd645b210 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:42.886979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 623/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:42.892977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:42.918163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:42.990702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c9b3-0238-4724-84bf-daef986e170e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:43.023033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:43.023625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:43.023908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:43.024184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:43.024901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=e477d29670604652952616a8600d11cf) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:43.025213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:43.026662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d685-8d12-44cd-8545-24b43041d55e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:43.031850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 637/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:32:42 2022] GET /identity/v3/role_assignments?user.id=e477d29670604652952616a8600d11cf&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:45.139381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3a556-722c-43c8-85c7-6761844e752b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:45.139936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3a556-722c-43c8-85c7-6761844e752b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:45.139936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3a556-722c-43c8-85c7-6761844e752b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:45.141236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 624/1261] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:45.146976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:45.147369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:45.147526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:45.165246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:45.166463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:45.230830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 638/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:45.525916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3a556-722c-43c8-85c7-6761844e752b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:45.536634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:45.624578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3a556-722c-43c8-85c7-6761844e752b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:45.656844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:45.657450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:45.657729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:45.658025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:45.667578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:45.672281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:45.673391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:45.674474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 625/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:45.679979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:45.698241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:45.791523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9368f-16c3-4db1-b16f-0c2645da0d3e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:45.824238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:45.824851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:45.825132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:45.825404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:45.826096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:45.826398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:45.827784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:45.835645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 639/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:45.841595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:45.911405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:45.943379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343308-2866-4f5e-89ee-2fd80498eaf4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:45.975255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:45.975864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:45.976142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:45.976412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:45.985807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:45.987911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:46.001845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:46.002967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:46.004095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:46.004095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:46.004095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:46.004095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 626/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 18:32:46.009116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.088042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:46.108227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e892c3-c946-4675-9b2e-5a97ca5fd492 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.140486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.141082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.141366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.141641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.142306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:46.142612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.144471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.155758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 640/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:46.162051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.258122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180b1b3-5bfc-4830-9098-99a06c1882ae None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.277025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:46.291398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.292012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.292287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.292555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.299925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.301361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:46.312160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:46.313305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:46.314542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 627/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:46.319060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.415789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6efe3-458d-4d2f-9ac7-657a7188adcb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.449123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.449710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.450016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.450292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.451012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:46.451314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.452719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.461613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:46.469927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 641/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:46.475713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.575791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d66a4-57d1-492f-8bc4-66b28dc6d40b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.608186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.608797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.609085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.609361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.620045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.621475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:46.635334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:46.636442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:46.640568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:46.640568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:46.640568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:46.640568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 628/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:46.642126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.739992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3bb99-2af8-4159-8eb3-be9505f6c544 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.773733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.774357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.774636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.774905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.775538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:46.775835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.777186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.789698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 642/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:46.795401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:46.826400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:46.895498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b15a32-ae86-4ca5-9d29-12d7f2947fb7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:46.927637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:46.928254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:46.928536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:46.928809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:46.935188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:46.936608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:46.947516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:46.948526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:46.949815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 629/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:46.954414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:47.011032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:47.052056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4de391-1687-4a0d-83ca-226b93dd1180 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:47.084295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:47.084881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:47.085159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:47.085430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:47.086136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:47.086439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:47.087842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a55e-4e7b-473b-8d39-c0cd88a7c22f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:47.099818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 643/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:47.105598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:47.198300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:47.208064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc426-b984-42b4-8288-f3a7331e74ee None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:47.239784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:47.240432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:47.240714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:47.240985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] PATH_INFO: `/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/e477d29670604652952616a8600d11cf/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:47.242895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b79641d6fe4cdd98ff11762978de2c, user_id=e477d29670604652952616a8600d11cf, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:47.244343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2ee9-577c-42b4-8c13-558550366648 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:47.257052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 630/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 8 18:32:47 2022] PUT /identity/v3/projects/55b79641d6fe4cdd98ff11762978de2c/users/e477d29670604652952616a8600d11cf/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:32:49.364661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69939391-994d-4cf0-ab66-e122763d0502 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:49.365173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69939391-994d-4cf0-ab66-e122763d0502 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:49.365281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69939391-994d-4cf0-ab66-e122763d0502 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:49.366570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 644/1274] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:49.371674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:49.372092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:49.372214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:49.390823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:49.391986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:49.454651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 631/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 18:32:49.723622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69939391-994d-4cf0-ab66-e122763d0502 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:49.824448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69939391-994d-4cf0-ab66-e122763d0502 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:49.842627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:49.864299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:49.865074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:49.865457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:49.865801 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:49.877455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 18:32:49.883222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:49.884374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:49.885244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 645/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 8 18:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:49.890714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:49.973732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:49.991850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2b51-9bf1-42a5-b322-bbe888028ae3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.025206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.025801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.026111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.026387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.027044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:50.027348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.028707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.037052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 632/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 8 18:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:50.042973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:50.139362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffb002-7e10-4bf6-9d36-81c868f43b3b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.172319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.172923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.173202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.173470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.183027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.184438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:50.199584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:50.200742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:50.201867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:50.201867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:50.201867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:50.201867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 646/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:50.206772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:50.301275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee1255-8788-4e8c-a209-3f293a97e9bb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.333609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.334233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.334514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.334781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.335402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:50.335698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.337034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.348067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 633/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:50.353700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:50.384424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:50.451478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f615e2-aae5-47de-b057-333dd3e00a93 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.483696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.484304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.484583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.484854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.491965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.493380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 18:32:50.504638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:50.505733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:50.507204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 647/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:50.511622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:50.515333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:50.607488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca138-f26d-4280-9089-b2177f6e1ce2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.640290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.640876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.641152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.641419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.642150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:50.642452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.643891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.660061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 634/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:50.665557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:50.753802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:50.763870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3edd13-417a-427e-b4b8-a997a798f073 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:50.796492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:50.797079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:50.797360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:50.797635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:50.865197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:50.866602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:50.952018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:50.962106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 648/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 18:32:50.968017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:51.027562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:51.065229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546b73-9baf-4954-a92e-f0654ee8e014 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:51.097521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:51.098158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:51.098439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:51.098710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:51.108204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:51.109616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 18:32:51.124123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:51.125207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 18:32:51.126381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 18:32:51.126381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 18:32:51.126381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:51.126381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 635/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:51.130819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:51.226685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc14ae3-f6f4-4f97-ace7-58632c49d41d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:51.259810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:51.260400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:51.260681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:51.260957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:51.261587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:51.261889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:51.263284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:51.274500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 649/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 8 18:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:51.280082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:51.376242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4c11-cc25-4958-adeb-918d86d6e17e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:51.389723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:51.410471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:51.411088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:51.411364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:51.411632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:51.418033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:51.419453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 18:32:51.430279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:51.431176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Sep 08 18:32:51.432105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 636/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 8 18:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:51.437405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:51.486578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:51.537092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0643-06bc-4c35-bb25-8e71e26f428c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:51.569085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:51.569678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:51.569980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:51.570259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:51.570944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:51.571273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:51.572697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2af11-c2ef-4c82-b223-3a52f7558b8f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:51.584675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 650/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 8 18:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:51.590734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:51.686818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c023ad-ed11-498b-a0cc-ee9dbeb43c95 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:51.719611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:51.720219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:51.720503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:51.720778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:51.721510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] RBAC: Adding query filter params (role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9, scope.project.id=55b79641d6fe4cdd98ff11762978de2c, user.id=e477d29670604652952616a8600d11cf) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:51.721865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:51.723340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b0a5b-dda2-4797-89da-85c29cefa08b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:51.729902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 637/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 8 18:32:51 2022] GET /identity/v3/role_assignments?user.id=e477d29670604652952616a8600d11cf&scope.project.id=55b79641d6fe4cdd98ff11762978de2c&role.id=a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:53.863789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d21f-a8b2-4023-9639-abf6ca6b3728 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:53.864385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d21f-a8b2-4023-9639-abf6ca6b3728 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:53.864385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d21f-a8b2-4023-9639-abf6ca6b3728 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:53.866032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 651/1288] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:53.871831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:53.872284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:53.872430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:53.893256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:53.894720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:53.925280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:53.963964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 638/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:54.249759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d21f-a8b2-4023-9639-abf6ca6b3728 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:54.349146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d21f-a8b2-4023-9639-abf6ca6b3728 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:54.360190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:54.388226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:54.388847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:54.389128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:54.389399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:54.390003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:54.391359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:54.400521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:54.401768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:54.402994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 652/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:32:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:54.407603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:54.505995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd486aa-d447-456e-8db5-e1f5e677bdef None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:54.539095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:54.539692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:54.539970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:54.540237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:54.540852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:54.541149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:54.542534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33145f10-bbb5-4bb2-a020-93cbf90595b2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:54.547181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 639/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 8 18:32:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:54.552942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:54.653087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d97c58-8db4-4f0e-b95e-f4312d1b6fed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:54.686178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:54.686775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:54.687144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:54.687412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:54.688093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:32:54.688389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:54.689805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11baee4-f020-4f6c-8404-4f0c912e1a08 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:54.694648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 653/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 8 18:32:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:32:56.797629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dafe6-e590-4b60-9c61-bb9b9f55eb78 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:56.798203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dafe6-e590-4b60-9c61-bb9b9f55eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:56.798203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dafe6-e590-4b60-9c61-bb9b9f55eb78 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:56.799563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 640/1293] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:56.804595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e814d4-2ffc-4664-817f-8c180c44e883 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:56.804993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e814d4-2ffc-4664-817f-8c180c44e883 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:56.805151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e814d4-2ffc-4664-817f-8c180c44e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:56.823003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-77e814d4-2ffc-4664-817f-8c180c44e883 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:56.824187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77e814d4-2ffc-4664-817f-8c180c44e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:56.855437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:56.899209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 654/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:57.165618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dafe6-e590-4b60-9c61-bb9b9f55eb78 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:57.196107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:32:57.264115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dafe6-e590-4b60-9c61-bb9b9f55eb78 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:57.296988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:57.297590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:57.297876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:57.298176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:57.298832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:57.300187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a61a9-c497-4102-9548-22aec17c0e26 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:57.314039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 641/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 8 18:32:57 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:32:59.448204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fac8d-8b0b-404c-a66e-e8bfc170ca8d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:59.448722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fac8d-8b0b-404c-a66e-e8bfc170ca8d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:59.448722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fac8d-8b0b-404c-a66e-e8bfc170ca8d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:59.450199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 655/1296] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:32:59.455459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:59.455891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:59.456026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:59.474263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:32:59.475450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:32:59.545662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 642/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:32:59.810870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fac8d-8b0b-404c-a66e-e8bfc170ca8d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:59.922001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fac8d-8b0b-404c-a66e-e8bfc170ca8d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:32:59.955102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:32:59.955719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:32:59.955995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:32:59.956889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:32:59.957507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:32:59.958910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:32:59.967568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:32:59.968724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:32:59.969743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 656/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:32:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:32:59.974727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:32:59.992287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:00.070833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c651c8-37e0-4caa-921e-500390f3d921 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:00.103027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:00.103623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:00.103904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:00.104177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:00.104802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:33:00.105107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:00.106487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:00.111367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 643/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 8 18:32:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:33:00.117347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:33:00.149261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:00.216837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1efc9-cb95-4ccd-a712-98f1a4ccbf01 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:00.248781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:00.249373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:00.249654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:00.249926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:00.250645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] RBAC: Adding query filter params (interface=public, service_id=f78a8400345c401c8cf33ba8405ca920, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:33:00.250951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:00.252298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038bdd8-9027-45c2-980f-adbbb5c4cd9b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:00.257907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 657/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 8 18:33:00 2022] GET /identity/v3/endpoints?service_id=f78a8400345c401c8cf33ba8405ca920&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:33:00.263450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:33:00.342127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:00.359398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865b8e-6fca-4e75-94eb-6eeda3f57b58 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:00.392565 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:00.393159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:00.393442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:00.393752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:00.394376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:00.395728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69ff8f-4dee-42df-b72d-20d5fc3944fd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:00.402242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 644/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 8 18:33:00 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:33:02.596082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e10e3-adfa-474b-9bc3-ad6237af9e9b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:02.596605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e10e3-adfa-474b-9bc3-ad6237af9e9b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:02.596605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e10e3-adfa-474b-9bc3-ad6237af9e9b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:02.598476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 658/1302] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:33:02.603814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:02.604234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:02.604343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:02.621908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:33:02.623100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:33:02.686590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 645/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:33:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 18:33:02.952278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e10e3-adfa-474b-9bc3-ad6237af9e9b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:33:03.045474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:03.052423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e10e3-adfa-474b-9bc3-ad6237af9e9b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:03.085228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:03.085835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:03.086147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:03.086419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:03.086992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:03.088348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 18:33:03.096867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 18:33:03.098104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 08 18:33:03.099132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 659/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 8 18:33:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 18:33:03.103881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:33:03.176103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:03.205804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca720362-c963-481b-8fa0-25d5503fe6df None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:03.249628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:03.250254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:03.250534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:03.250809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:03.251431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:33:03.251733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:03.253591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ae313-69a5-4444-9fa3-37997a0055bf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:03.258875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 646/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 8 18:33:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:33:03.264817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:33:03.361037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a462-9579-4eaa-8230-568c480cbaa3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:33:03.394545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:33:03.395138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:33:03.395420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:33:03.395692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:33:03.396344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:33:03.397713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17d7e-ce14-4713-a014-3e363551d8fd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:33:03.416136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 660/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:33:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:33:13.256175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=30 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:33:13.412058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:07.456175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3bd9d-fce4-4f12-9744-b997eff79537 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:07.458057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3bd9d-fce4-4f12-9744-b997eff79537 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:07.458665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3bd9d-fce4-4f12-9744-b997eff79537 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:07.466679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c9d1-ab07-4a16-8fcb-4a3902b903ad None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:07.467100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c9d1-ab07-4a16-8fcb-4a3902b903ad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:07.467235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7c9d1-ab07-4a16-8fcb-4a3902b903ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:07.470580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 647/1307] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:07 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:07.573212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d4a7c9d1-ab07-4a16-8fcb-4a3902b903ad None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:07.574518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d4a7c9d1-ab07-4a16-8fcb-4a3902b903ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:07.705107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 661/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:08.004124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:08.004410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:08.005015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:08.006571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 648/1309] 10.222.0.18 () {54 vars in 965 bytes} [Thu Sep 8 18:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:34:08.013692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d0ab-5dfa-4102-9e67-f9fa57a7b4b0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:08.014045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d0ab-5dfa-4102-9e67-f9fa57a7b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:08.014291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04d0ab-5dfa-4102-9e67-f9fa57a7b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:08.101426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ca04d0ab-5dfa-4102-9e67-f9fa57a7b4b0 None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:08.102912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca04d0ab-5dfa-4102-9e67-f9fa57a7b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:08.126631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:08.186638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 662/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Sep 8 18:34:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:08.196091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:08.198120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:08.322283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923f174-2dc8-4aa3-9c63-e11b4f8485d9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:08.402395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:08.402933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:08.403197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:08.403463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:08.405038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:08.462104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:08.519202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:08.520629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f495c44-518a-423f-bb09-35d258d0b867 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:08.539980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 649/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:11.059433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:11.059936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:11.060030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:11.061301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 663/1312] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:11.067114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726d5c-4158-474f-ab54-ace7a9f6498c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:11.067495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726d5c-4158-474f-ab54-ace7a9f6498c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:11.067669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726d5c-4158-474f-ab54-ace7a9f6498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:11.148046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-87726d5c-4158-474f-ab54-ace7a9f6498c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:11.149153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-87726d5c-4158-474f-ab54-ace7a9f6498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:11.243805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 650/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:11.531130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:11.532675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:11.633992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bdcc8-faa9-4dda-95d0-10b710fe79b4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:11.710353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:11.713123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:11.713929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:11.714293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:11.714703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:11.716503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:11.822947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:11.824341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22abfe-7e4e-4d8f-879b-041082cdd5c1 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:11.842741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 664/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:14.301145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:14.301593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:14.301686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:14.303080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 651/1315] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:14.308266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42048fa-cf84-481f-b18a-8247c15e4a79 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:14.308667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42048fa-cf84-481f-b18a-8247c15e4a79 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:14.308820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42048fa-cf84-481f-b18a-8247c15e4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:14.376269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c42048fa-cf84-481f-b18a-8247c15e4a79 None None] MFA Rules not processed for user `a5ca536e9de3472b97cc07f0a37e1327`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:14.377496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c42048fa-cf84-481f-b18a-8247c15e4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:14.430088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:14.474454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 665/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:14.759408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:14.761185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:14.771302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:14.864861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11d35-292d-401b-af4c-f950a82fe56f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:14.938833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:14.939436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:14.939718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:14.939990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:14.942146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:15.005204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:15.055772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:15.057210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474e84-b6dd-4369-9db1-c431e22ebb15 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:15.075790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 652/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:17.719136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d643-8789-4125-9aa7-410926320079 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:17.719662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d643-8789-4125-9aa7-410926320079 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:17.719662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008d643-8789-4125-9aa7-410926320079 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:17.721001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 666/1318] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:17.726770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45656-6f7c-47bd-ad99-0672f3805f7a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:17.727156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45656-6f7c-47bd-ad99-0672f3805f7a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:17.727315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45656-6f7c-47bd-ad99-0672f3805f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:17.791551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-30f45656-6f7c-47bd-ad99-0672f3805f7a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:17.792759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-30f45656-6f7c-47bd-ad99-0672f3805f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:17.885644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 653/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:18.168904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d643-8789-4125-9aa7-410926320079 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:18.170505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c008d643-8789-4125-9aa7-410926320079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:18.273327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008d643-8789-4125-9aa7-410926320079 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:18.349742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:18.350569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:18.350845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:18.351115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:18.352893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:18.360046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:18.460622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:18.461987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379e726-75d8-4579-bc05-3afdaf6eff36 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:18.479329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 667/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:21.293572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a8f2-dd99-4320-9ad3-f4dc8ce4d328 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:21.294142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a8f2-dd99-4320-9ad3-f4dc8ce4d328 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:21.294402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a8f2-dd99-4320-9ad3-f4dc8ce4d328 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:21.296311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 654/1321] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:21.302567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e24-b012-435b-aaa8-4c3f3605871c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:21.303115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e24-b012-435b-aaa8-4c3f3605871c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:21.303115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e24-b012-435b-aaa8-4c3f3605871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:21.374890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ee8d1e24-b012-435b-aaa8-4c3f3605871c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:21.376119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee8d1e24-b012-435b-aaa8-4c3f3605871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:21.439376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:21.483035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 668/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:21.775460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:21.775749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:21.776032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:21.777371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 655/1323] 10.222.0.18 () {54 vars in 965 bytes} [Thu Sep 8 18:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:21.783259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4261-77f4-40d0-a546-600b010f7144 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:21.783543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4261-77f4-40d0-a546-600b010f7144 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:21.783844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4261-77f4-40d0-a546-600b010f7144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:21.861255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-504f4261-77f4-40d0-a546-600b010f7144 None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:21.862489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-504f4261-77f4-40d0-a546-600b010f7144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:21.937118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 669/1324] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Sep 8 18:34:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:21.946705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:21.948243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:21.968692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:22.050757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e850c-195d-4eea-a044-b93e3448fa43 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:22.121880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:22.122501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:22.122776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:22.123043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:22.124618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:22.195740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:22.233105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:22.234606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fddaa-5aaa-4feb-b2dd-6f9cd3a91546 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:22.253208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 656/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:24.705800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:24.706420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:24.706760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:24.709825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 670/1326] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:24.715288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969a3ff-3fca-4ba5-a652-6ead4e090a6e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:24.715747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969a3ff-3fca-4ba5-a652-6ead4e090a6e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:24.715849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969a3ff-3fca-4ba5-a652-6ead4e090a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:24.781657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1969a3ff-3fca-4ba5-a652-6ead4e090a6e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:24.782901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1969a3ff-3fca-4ba5-a652-6ead4e090a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:24.879038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 657/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:25.159771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:25.161332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:25.221694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:25.269277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d976-71e4-4098-8a26-66e39aa4dc96 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:25.342511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:25.343117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:25.343396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:25.343666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:25.345258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:25.453969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:25.456440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:25.458434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f83b7-6567-4200-b20e-6dc57e549962 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:25.479707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 671/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:27.699180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:27.699734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:27.699734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:27.701053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 658/1329] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:27.706504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f69ff-7880-482a-9118-7920d8dc237d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:27.706935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f69ff-7880-482a-9118-7920d8dc237d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:27.707043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f69ff-7880-482a-9118-7920d8dc237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:27.777988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b69f69ff-7880-482a-9118-7920d8dc237d None None] MFA Rules not processed for user `a5ca536e9de3472b97cc07f0a37e1327`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:27.779193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b69f69ff-7880-482a-9118-7920d8dc237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:27.875039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 672/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:28.165143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:28.166714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:28.198183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:28.272717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ae64-ba46-424e-95de-48135871fb5c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:28.348289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:28.348921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:28.349198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:28.349464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:28.351089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:28.431655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:28.465093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:28.466586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c53c7-bcbc-4ca6-918e-9060233b6d9f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:28.485524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 659/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:30.841922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:30.842557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:30.842557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:30.843977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 673/1332] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:30.849610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e4de-4d6e-4455-bea1-5b16fe9baf19 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:30.850080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e4de-4d6e-4455-bea1-5b16fe9baf19 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:30.850190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e4de-4d6e-4455-bea1-5b16fe9baf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:30.919795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f568e4de-4d6e-4455-bea1-5b16fe9baf19 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:30.920997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f568e4de-4d6e-4455-bea1-5b16fe9baf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:31.021251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 660/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:34:31.302598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:31.304142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:31.373332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:31.407998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b83166-0ee7-436c-baf0-f76e97c956fc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:31.480963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:31.481562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:31.481838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:31.482136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:31.483717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:31.590111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:31.591505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66cee2-df3f-446a-953c-50b8eb10d404 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:31.601189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:31.609468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 674/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:33.766925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:33.767492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:33.767492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:33.768800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 661/1335] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:33.773970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaf048-9bac-43a6-aa7a-ac23ddf31c9f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:33.774383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaf048-9bac-43a6-aa7a-ac23ddf31c9f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:33.774524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaf048-9bac-43a6-aa7a-ac23ddf31c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:33.860133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0ebaf048-9bac-43a6-aa7a-ac23ddf31c9f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:33.861442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0ebaf048-9bac-43a6-aa7a-ac23ddf31c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:33.959191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 675/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:34.254459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:34.255979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:34.296595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:34.357993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a58fc-b946-4c61-9245-1fad1f0176f0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:34.428862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:34.429467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:34.429741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:34.430031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:34.431608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:34.514394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:34.539727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:34.541150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665df30-6239-4c07-8270-172a4ad8f5c3 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:34.558850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 662/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:37.043958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:37.044547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:37.044547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:37.045826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 676/1338] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:37.050930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e827-dc81-4943-a924-eaa6e9d321b9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:37.051343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e827-dc81-4943-a924-eaa6e9d321b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:37.051521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e827-dc81-4943-a924-eaa6e9d321b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:37.115999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c538e827-dc81-4943-a924-eaa6e9d321b9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:37.117192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c538e827-dc81-4943-a924-eaa6e9d321b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:37.212733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 663/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:37.494811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:37.496351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:37.571806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:37.598830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51de92-3993-4cdb-afea-800efd633714 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:37.673674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:37.674313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:37.674591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:37.674861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:37.676463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:37.783335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:37.784701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704639ac-fa00-4050-ae30-3a68aca89d39 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:37.802757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 677/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:41.814672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:41.815246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:41.815246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:41.816555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 664/1341] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:41.821771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a619ff-0f59-4b63-b8dd-0dc691d9f4ef None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:41.822258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a619ff-0f59-4b63-b8dd-0dc691d9f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:41.822368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a619ff-0f59-4b63-b8dd-0dc691d9f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:41.827925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:41.890886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d6a619ff-0f59-4b63-b8dd-0dc691d9f4ef None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:41.892070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d6a619ff-0f59-4b63-b8dd-0dc691d9f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:41.996457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 678/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:34:42.280440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:42.282869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:42.340079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:42.395474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9284-6761-4028-8c84-ac9c27705b41 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:42.468970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:42.469575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:42.469854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:42.470150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:42.471733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:42.564951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:42.586017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:42.587467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85225938-e001-41ed-9bee-63d38eb9904c service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:42.607968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 665/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:45.392359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:45.392883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:45.393023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:45.394413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 679/1344] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:45.399843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f118-61b5-4178-a7e5-72365ebe9d89 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:45.400252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f118-61b5-4178-a7e5-72365ebe9d89 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:45.400564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f118-61b5-4178-a7e5-72365ebe9d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:45.476299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-feb0f118-61b5-4178-a7e5-72365ebe9d89 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:45.477676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-feb0f118-61b5-4178-a7e5-72365ebe9d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:45.575078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 666/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:34:45.868337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:45.870830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:45.973005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:45.992027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71723e-d413-4c24-be2c-b7bfc0d6bbfa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:46.068876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:46.069482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:46.069759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:46.070058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:46.071624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:46.179735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:46.181174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e28d19-9200-4a92-99c6-382f442f943c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:46.198783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 680/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:50.348047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:50.348535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:50.348627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:50.350486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 667/1347] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:50.355918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2f25-a84a-4f16-a9b7-553f61105b26 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:50.356337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2f25-a84a-4f16-a9b7-553f61105b26 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:50.356477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2f25-a84a-4f16-a9b7-553f61105b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:50.372938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:50.427412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9e8a2f25-a84a-4f16-a9b7-553f61105b26 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:50.429247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e8a2f25-a84a-4f16-a9b7-553f61105b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:50.529985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 681/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:34:50.816426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:34:50.817999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:50.876386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:50.924219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fbaba-b5ef-49cd-90e8-a48d18f19cca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:34:51.004653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:34:51.005270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:51.005554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:51.005826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:51.008361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:51.117648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:34:51.121771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:34:51.123232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406f511-05ed-41ab-95ca-5718499cf04c service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:34:51.142257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 668/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:34:56.094909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e9a3-b776-4af3-9b21-d09acc6f3499 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:56.095382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e9a3-b776-4af3-9b21-d09acc6f3499 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:56.095382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8e9a3-b776-4af3-9b21-d09acc6f3499 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:56.097203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 682/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:34:56.104405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdcac-6ea2-41b5-b0b0-142801043604 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:34:56.105127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdcac-6ea2-41b5-b0b0-142801043604 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:34:56.105576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbdcac-6ea2-41b5-b0b0-142801043604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:34:56.255492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9dcbdcac-6ea2-41b5-b0b0-142801043604 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:34:56.257265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9dcbdcac-6ea2-41b5-b0b0-142801043604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:34:56.389563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 669/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:34:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:00.459935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf3d0-8753-48ad-9252-ad4f335bfc6b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:00.460454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf3d0-8753-48ad-9252-ad4f335bfc6b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:00.460454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf3d0-8753-48ad-9252-ad4f335bfc6b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:00.461990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 683/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:00.466883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c6f-614f-401c-af28-fa0d0ea73703 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:00.467315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c6f-614f-401c-af28-fa0d0ea73703 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:00.467437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c6f-614f-401c-af28-fa0d0ea73703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:00.523608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:00.529074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=59 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:00.547249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-49a26c6f-614f-401c-af28-fa0d0ea73703 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:00.548353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-49a26c6f-614f-401c-af28-fa0d0ea73703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:00.660483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 670/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:35:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:02.151601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9c03-c5a1-477d-a66a-a749caf0bdf0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:02.152159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9c03-c5a1-477d-a66a-a749caf0bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:02.152159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9c03-c5a1-477d-a66a-a749caf0bdf0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:02.153463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 684/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:02.158485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07a9d-0b94-4c85-8e49-2c27e97683ff None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:02.158922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07a9d-0b94-4c85-8e49-2c27e97683ff None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:02.159060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07a9d-0b94-4c85-8e49-2c27e97683ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:02.235171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-84b07a9d-0b94-4c85-8e49-2c27e97683ff None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:02.236379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-84b07a9d-0b94-4c85-8e49-2c27e97683ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:02.278830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:02.342293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 671/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:35:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:35:05.899508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe06d2-e87b-4eec-84bd-76da0ea73849 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:05.900008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe06d2-e87b-4eec-84bd-76da0ea73849 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:05.900008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe06d2-e87b-4eec-84bd-76da0ea73849 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:05.901516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 685/1356] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:05.907298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64abadd-0fb1-480e-90b0-5cc895f39d2d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:05.907786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64abadd-0fb1-480e-90b0-5cc895f39d2d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:05.907868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64abadd-0fb1-480e-90b0-5cc895f39d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:05.978278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e64abadd-0fb1-480e-90b0-5cc895f39d2d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:05.979406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e64abadd-0fb1-480e-90b0-5cc895f39d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:06.080386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 672/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:06.386719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:06.387800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:06.388395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:06.390368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 686/1358] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 8 18:35:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:06.398652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c516a94-c9ec-4b1c-8d1c-1d90919b2905 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:06.399234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c516a94-c9ec-4b1c-8d1c-1d90919b2905 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:06.399700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c516a94-c9ec-4b1c-8d1c-1d90919b2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:06.432806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:06.494752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3c516a94-c9ec-4b1c-8d1c-1d90919b2905 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:06.495852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3c516a94-c9ec-4b1c-8d1c-1d90919b2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:06.642397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 673/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 8 18:35:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:06.651163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:06.655339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:06.808798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a469e4-9bcc-4e5f-ab7f-13732f2f9f3a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:06.902052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:06.949593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:06.950232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:06.950518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:06.950793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:06.952382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:07.058940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:07.060462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c5707-af28-4ab7-b6b4-72b48c90da6a service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:07.079990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 687/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:35:09.458843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:09.459926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:09.459926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:09.461261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 674/1361] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:09.466706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131084-ebf7-4227-84ae-9a680623dde6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:09.467765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131084-ebf7-4227-84ae-9a680623dde6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:09.468121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42131084-ebf7-4227-84ae-9a680623dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:09.546688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-42131084-ebf7-4227-84ae-9a680623dde6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:09.547882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-42131084-ebf7-4227-84ae-9a680623dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:09.593747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:09.662085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 688/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:09.944920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:09.946471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:10.015622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:10.117432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03dcce-47de-4746-b12f-e0db4289eb35 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:10.250045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:10.250666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:10.250975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:10.251248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:10.252846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:10.281297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:10.352008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:10.353608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2d6c-9bb8-4ca4-a842-fc7f451bdacd service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:10.372646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 675/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:35:12.871570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b91c3-fb70-4db3-9efa-59f90d3cc3cf None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:12.872075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b91c3-fb70-4db3-9efa-59f90d3cc3cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:12.872075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b91c3-fb70-4db3-9efa-59f90d3cc3cf None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:12.873368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 689/1364] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:12.879195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611ada-1a4f-41d7-89e5-433ee9fab159 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:12.879621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611ada-1a4f-41d7-89e5-433ee9fab159 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:12.879794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611ada-1a4f-41d7-89e5-433ee9fab159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:12.949139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-64611ada-1a4f-41d7-89e5-433ee9fab159 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:12.950462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-64611ada-1a4f-41d7-89e5-433ee9fab159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:13.051044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:13.059079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 676/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:13.345336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:13.345978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:13.346354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:13.347912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 690/1366] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 8 18:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:13.353475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0a605-bc78-41d6-8f77-dfe153e5e68c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:13.353766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0a605-bc78-41d6-8f77-dfe153e5e68c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:13.354069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0a605-bc78-41d6-8f77-dfe153e5e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:13.440676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fae0a605-bc78-41d6-8f77-dfe153e5e68c None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:13.441886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fae0a605-bc78-41d6-8f77-dfe153e5e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:13.576261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 677/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 8 18:35:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:13.583689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:13.585297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:13.736617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997712a-9faf-4d33-a7fd-44244c1a498f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:13.758137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:13.870924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:13.871610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:13.872151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:13.872332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:13.874062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:13.970983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:13.972731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90c6f-0c5f-4bc3-9670-03f4c2f8cb71 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:13.992496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 691/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:14.162361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e3e4-18c4-43cb-b2aa-e0811353e123 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:14.162910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e3e4-18c4-43cb-b2aa-e0811353e123 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:14.162910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e3e4-18c4-43cb-b2aa-e0811353e123 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:14.165997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 678/1369] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:14.170287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4baf-9439-42c1-bdd7-52e779df8ba9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:14.170779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4baf-9439-42c1-bdd7-52e779df8ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:14.171063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4baf-9439-42c1-bdd7-52e779df8ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:14.207533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:14.251460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-088f4baf-9439-42c1-bdd7-52e779df8ba9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:14.252746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-088f4baf-9439-42c1-bdd7-52e779df8ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:14.370461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 692/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:14.708792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:14.708792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:14.708792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:14.710624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 679/1371] 10.222.0.18 () {54 vars in 964 bytes} [Thu Sep 8 18:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:14.715123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfedbc-6b9f-48a4-98d9-3287b08babc0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:14.715414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfedbc-6b9f-48a4-98d9-3287b08babc0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:14.715695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfedbc-6b9f-48a4-98d9-3287b08babc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:14.797925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aadfedbc-6b9f-48a4-98d9-3287b08babc0 None None] MFA Rules not processed for user `2e694edc3a35429b8a2041261f9459e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:14.799171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aadfedbc-6b9f-48a4-98d9-3287b08babc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:14.848274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:14.884318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 693/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Sep 8 18:35:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:14.892144 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:14.894001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:14.955058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:15.016058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e303d0-6dac-4072-9ebd-f70c97424624 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:15.096624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:15.097239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:15.097520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:15.097790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:15.100315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:15.212415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:15.232850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:15.234709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689efde-5f56-4bb4-baa7-a1bcc4be99b2 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:15.257046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 680/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:35:16.261877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:16.262685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:16.262797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:16.264044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 694/1374] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:16.269575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645a24-f8b8-4775-b082-8eb81946a3fd None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:16.270426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645a24-f8b8-4775-b082-8eb81946a3fd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:16.270702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645a24-f8b8-4775-b082-8eb81946a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:16.339261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8f645a24-f8b8-4775-b082-8eb81946a3fd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:16.340450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8f645a24-f8b8-4775-b082-8eb81946a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:16.434468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 681/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:16.729498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:16.731128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:16.895838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468bffd-bfad-4cda-af9a-b260ee47decf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:16.949901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:17.014039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:17.014656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:17.014938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:17.015216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:17.016830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:17.116112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:17.118024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30ab12-25a9-44e4-96c3-f776456fabe8 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:17.137537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 695/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:19.371784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:19.372331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:19.372331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:19.373672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 682/1377] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:19.379035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b51bb-ea5e-4efb-8f25-9549d8666b1d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:19.379476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b51bb-ea5e-4efb-8f25-9549d8666b1d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:19.379580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b51bb-ea5e-4efb-8f25-9549d8666b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:19.448535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-da0b51bb-ea5e-4efb-8f25-9549d8666b1d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:19.449902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-da0b51bb-ea5e-4efb-8f25-9549d8666b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:19.457217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:19.560931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 696/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:19.855421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:19.856930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:19.929348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:20.019766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2745e-1f55-4dad-8092-53fd8429d367 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:20.139879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:20.140523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:20.140809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:20.141079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:20.142674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:20.163024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:20.238319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:20.240552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db8fa2-5fc6-4ec2-bb62-0b7bcaae16b8 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:20.259950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 683/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:22.514681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:22.515150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:22.515366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:22.516723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 697/1380] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:22.522239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8f03-7fda-48d3-b0e2-c6fbe134683c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:22.522624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8f03-7fda-48d3-b0e2-c6fbe134683c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:22.522810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8f03-7fda-48d3-b0e2-c6fbe134683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:22.610936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9fdd8f03-7fda-48d3-b0e2-c6fbe134683c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:22.613813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9fdd8f03-7fda-48d3-b0e2-c6fbe134683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:22.754657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:22.761469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 684/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:35:23.051046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:23.053155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:23.217737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:23.229006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3308a-129d-4aae-b519-f51004bc41c5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:23.347221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:23.347823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:23.348093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:23.348368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:23.350012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:23.461702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:23.463933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd59a-e80e-4630-8bfb-41692498d267 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:23.476838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:23.487628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 698/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:25.995711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:25.996247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:25.996247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:25.997631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 685/1383] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:26.003972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e8336-ee64-4134-bf75-2e5c95a231c5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:26.004379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e8336-ee64-4134-bf75-2e5c95a231c5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:26.004737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e8336-ee64-4134-bf75-2e5c95a231c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:26.088227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3e7e8336-ee64-4134-bf75-2e5c95a231c5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:26.089430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3e7e8336-ee64-4134-bf75-2e5c95a231c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:26.192296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 699/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:26.479769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:26.481295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:26.629954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae285f7-98f2-4891-b942-cbb3b6cc30b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:26.696778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:26.757762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:26.758568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:26.758924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:26.759282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:26.761414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:26.884166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:26.885767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a24b3-bb9c-433d-98c4-1bae1fa471bd service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:26.904272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 686/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:29.063803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:29.064335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:29.064462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:29.065734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 700/1386] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:29.071913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a2d7-0af3-4636-aa4a-832b8bd20b16 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:29.072312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a2d7-0af3-4636-aa4a-832b8bd20b16 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:29.072465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a2d7-0af3-4636-aa4a-832b8bd20b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:29.142859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b410a2d7-0af3-4636-aa4a-832b8bd20b16 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:29.144063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b410a2d7-0af3-4636-aa4a-832b8bd20b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:29.179109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:29.243112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 687/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:29.538977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:29.540548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:29.617150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:29.686016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17ed0-5e64-4eeb-acaf-e4307cb3d163 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:29.805522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:29.806077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:29.806357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:29.806629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:29.808195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:29.847087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:29.900463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:29.902092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bc33-9c7b-42b0-bf01-d5dae9cf6250 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:29.919944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 701/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:30.463967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede7c5-ecac-4ed7-a408-a0c0481d707a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:30.464518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede7c5-ecac-4ed7-a408-a0c0481d707a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:30.464518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede7c5-ecac-4ed7-a408-a0c0481d707a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:30.465898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 688/1389] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:30.471205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e7f-57f3-4e98-bb74-7813a5c1eb67 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:30.471690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e7f-57f3-4e98-bb74-7813a5c1eb67 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:30.471785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26791e7f-57f3-4e98-bb74-7813a5c1eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:30.537899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-26791e7f-57f3-4e98-bb74-7813a5c1eb67 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:30.539061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26791e7f-57f3-4e98-bb74-7813a5c1eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:30.636327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 702/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:30.945439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:30.945731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:30.946042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:30.947374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 689/1391] 10.222.0.18 () {54 vars in 966 bytes} [Thu Sep 8 18:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:35:30.952621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4e08d-0bc3-4d37-b1ca-4c872286e40d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:30.952909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4e08d-0bc3-4d37-b1ca-4c872286e40d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:30.953211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4e08d-0bc3-4d37-b1ca-4c872286e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:30.968875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:31.032404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-03b4e08d-0bc3-4d37-b1ca-4c872286e40d None None] MFA Rules not processed for user `6fc5a9468ff5431e972345db08ac876d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:31.033721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-03b4e08d-0bc3-4d37-b1ca-4c872286e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:31.116780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 703/1392] 10.222.0.18 () {58 vars in 1063 bytes} [Thu Sep 8 18:35:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:31.127041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:31.128539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:31.250090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd646-3f04-4c9d-a419-8561be5a2955 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:31.316414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:31.332447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:31.334176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:31.334470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:31.334746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:31.336492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:31.443860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:31.445297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41fd9f-377a-48f4-a471-a9dea009944a service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:31.463636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 690/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:32.115521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a52e-1dec-4c00-b9db-2bba241efd84 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.115880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a52e-1dec-4c00-b9db-2bba241efd84 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.115966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362a52e-1dec-4c00-b9db-2bba241efd84 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.117656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 704/1394] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:32.123072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00fd3-1670-4a0f-aff8-4b106d504918 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.123072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00fd3-1670-4a0f-aff8-4b106d504918 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.123687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab00fd3-1670-4a0f-aff8-4b106d504918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.199183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8ab00fd3-1670-4a0f-aff8-4b106d504918 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:32.200415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ab00fd3-1670-4a0f-aff8-4b106d504918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:32.221649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1b1e-46b9-4558-923d-729a41ab5bd8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.221975 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1b1e-46b9-4558-923d-729a41ab5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.222274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1b1e-46b9-4558-923d-729a41ab5bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.248200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:32.311133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-41ae1b1e-46b9-4558-923d-729a41ab5bd8 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:32.312401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-41ae1b1e-46b9-4558-923d-729a41ab5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:32.319081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 691/1395] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:32.373633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:32.409057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 705/1396] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:35:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:35:32.452953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.453246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.453529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.455008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 692/1397] 10.222.0.18 () {54 vars in 943 bytes} [Thu Sep 8 18:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:32.461423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.461806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.462180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.555099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] MFA Rules not processed for user `acb5646ccfe0421591346d235e8f3cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:32.556299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:32.627007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:32.628434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:32.664100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 706/1398] 10.222.0.18 () {58 vars in 1040 bytes} [Thu Sep 8 18:35:32 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:32.673736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:32.683201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262b80-0c1e-4837-8e8e-f63acedebe2b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:32.709146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:32.776911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779fc4-6c99-4488-b027-bb7d54e0998f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:32.790115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:32.790725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.791004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.791276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.792913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:32.803320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:32.876942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:32.878615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1ea88-4b07-46b5-b0d3-bdf65acd94b0 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:32.887443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 707/1399] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:35:32.893834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:32.894485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:32.894753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:32.895024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:32.897177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:33.007662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:33.009398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780248e6-7537-482b-9256-d9b90ed01772 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:33.031014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 693/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:35.262849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:35.263390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:35.263390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:35.265800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 708/1401] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:35.272779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b1f6-db4b-466e-bfd7-7acdb461e28b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:35.272779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b1f6-db4b-466e-bfd7-7acdb461e28b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:35.272779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923b1f6-db4b-466e-bfd7-7acdb461e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:35.314974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:35.350465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8923b1f6-db4b-466e-bfd7-7acdb461e28b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:35.351813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8923b1f6-db4b-466e-bfd7-7acdb461e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:35.470112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 694/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:35.758216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:35.760053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:35.828997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:35.927925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3739d-32cf-44fb-871a-5703c19ca4e5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:36.055203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:36.056247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:36.056754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:36.057263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:36.059177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:36.080718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:36.167286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:36.168473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea65c48-6dc4-489d-8035-022e943b867f service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:36.204996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 709/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:38.489093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:38.490139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:38.490249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:38.491863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 695/1404] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:38.496907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377cf0-cd35-4bb8-ad1d-1577484fb015 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:38.497342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377cf0-cd35-4bb8-ad1d-1577484fb015 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:38.497437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377cf0-cd35-4bb8-ad1d-1577484fb015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:38.581555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d5377cf0-cd35-4bb8-ad1d-1577484fb015 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:38.583531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d5377cf0-cd35-4bb8-ad1d-1577484fb015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:38.693184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:38.700262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 710/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:39.012590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:39.014468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:39.138888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:39.191528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dac5d7-9ab0-4a5a-8ef8-cc67fbf28b75 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:39.323665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:39.324273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:39.324550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:39.324817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:39.326442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:39.405049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:39.426900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:39.428517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1ffaa-601b-4d47-8f45-7ca10ceb545c service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:39.448025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 696/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:41.650422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:41.650947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:41.650947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:41.654810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 711/1407] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:41.657670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df412f-c849-4b4c-a9bd-8be33b6b4be3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:41.658150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df412f-c849-4b4c-a9bd-8be33b6b4be3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:41.658242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df412f-c849-4b4c-a9bd-8be33b6b4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:41.735995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d2df412f-c849-4b4c-a9bd-8be33b6b4be3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:41.737284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d2df412f-c849-4b4c-a9bd-8be33b6b4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:41.847209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 697/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:42.146871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:42.148398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:42.334662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1e33-1282-4fb8-a84b-1c63b58a7b92 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:42.412777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:42.464250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:42.464867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:42.465148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:42.465417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:42.467064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:42.566115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:42.568193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314eb91-4ef0-4971-a8fb-2b746de24393 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:42.588116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 712/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:35:51.845204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=79 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:52.585550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=64 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:55.474246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe96e1-efe6-4263-a71a-3b7556762c0e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:55.474886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe96e1-efe6-4263-a71a-3b7556762c0e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:55.474886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe96e1-efe6-4263-a71a-3b7556762c0e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:55.476134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 698/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Sep 8 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:55.481322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d835-d824-4079-8afa-ffac99886168 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:55.481732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d835-d824-4079-8afa-ffac99886168 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:55.481895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d835-d824-4079-8afa-ffac99886168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:55.557090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ed50d835-d824-4079-8afa-ffac99886168 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:55.558229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ed50d835-d824-4079-8afa-ffac99886168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:55.664624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 713/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 8 18:35:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:55.679257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287cc6-1a4b-4d29-867f-ff9f92a476e4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:55.679541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287cc6-1a4b-4d29-867f-ff9f92a476e4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:55.679814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287cc6-1a4b-4d29-867f-ff9f92a476e4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:55.681134 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 699/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Sep 8 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:55.685901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320919-435d-472e-94f4-7e726872655d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:55.686220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320919-435d-472e-94f4-7e726872655d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:55.686496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320919-435d-472e-94f4-7e726872655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:55.759103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:55.762568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ea320919-435d-472e-94f4-7e726872655d None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:55.764395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ea320919-435d-472e-94f4-7e726872655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:55.877935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 714/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 8 18:35:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:58.525316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:58.525906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:58.525906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:58.527221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:35:58.532721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fae87-106f-4589-9358-c4f85239b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:58.533122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fae87-106f-4589-9358-c4f85239b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:58.533234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fae87-106f-4589-9358-c4f85239b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:58.599448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d90fae87-106f-4589-9358-c4f85239b4a1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:35:58.600650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d90fae87-106f-4589-9358-c4f85239b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:58.656834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:58.699463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:35:58.995907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:35:58.997468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:59.139580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b6cd-f3b6-4dd3-b9cb-ece04aa8624b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:35:59.210549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:35:59.249782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:35:59.250439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:35:59.250719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:35:59.250991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:35:59.252576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:35:59.342624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:35:59.344229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffcbb4-8849-484c-8fba-047915313bee service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:35:59.362129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 701/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:00.502938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:00.503475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:00.503608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:00.504895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:00.511005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97908-16e1-400c-a563-1b1342b2e7ac None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:00.511442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97908-16e1-400c-a563-1b1342b2e7ac None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:00.511537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97908-16e1-400c-a563-1b1342b2e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:00.585801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-efe97908-16e1-400c-a563-1b1342b2e7ac None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:00.586945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-efe97908-16e1-400c-a563-1b1342b2e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:00.613691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:00.682334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:00.835457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:00.837025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:00.980140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ad3a-7c42-4c74-bf47-e1f443fb6698 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:01.020958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:01.092123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:01.092654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:01.092932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:01.093203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:01.094874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:01.182839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:01.184436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e41a82-a0a9-45ba-a1e2-92a7f6dd5ad3 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:01.202559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 717/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:02.336968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:02.337437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:02.337530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:02.338942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:02.345144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613c1a8-e8cc-482e-b7b0-d8020f369870 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:02.345578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613c1a8-e8cc-482e-b7b0-d8020f369870 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:02.345684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613c1a8-e8cc-482e-b7b0-d8020f369870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:02.399046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:02.420181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7613c1a8-e8cc-482e-b7b0-d8020f369870 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:02.421368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7613c1a8-e8cc-482e-b7b0-d8020f369870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:02.515972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:02.671713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:02.673228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:02.823637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013077-4ee9-4f7e-b693-f755572bc39c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:02.835564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:02.934239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:02.934890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:02.935016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:02.935252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:02.936829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:03.023712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:03.025284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49f055-f3a7-4a48-bf56-eb9e97e64667 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:03.043116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 704/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:04.145551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:04.146071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:04.146178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:04.147698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:04.154090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a348-a68a-4341-bfe4-17f0ec4e5940 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:04.154524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a348-a68a-4341-bfe4-17f0ec4e5940 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:04.154653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a348-a68a-4341-bfe4-17f0ec4e5940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:04.174028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:04.231543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-45e8a348-a68a-4341-bfe4-17f0ec4e5940 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:04.232750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-45e8a348-a68a-4341-bfe4-17f0ec4e5940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:04.328719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:04.480102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:04.481671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:04.591176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:04.628535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2c6f-c16c-4e70-9871-0fa148032af9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:04.740634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:04.741153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:04.741431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:04.741699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:04.743325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:04.819645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:04.835700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:04.837323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe069e-dda0-48c7-bf3a-8946429c6eb6 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:04.855678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 720/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:05.967043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:05.967621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:05.967621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:05.968957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:05.975621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7b61-68b3-45ed-9318-68637feb4c7b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:05.976056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7b61-68b3-45ed-9318-68637feb4c7b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:05.976165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7b61-68b3-45ed-9318-68637feb4c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:06.050333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce9f7b61-68b3-45ed-9318-68637feb4c7b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:06.052102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce9f7b61-68b3-45ed-9318-68637feb4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:06.144808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:06.295720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:06.297238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:06.379762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:06.440500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5fac7-17cd-4ff3-8dea-f6ae1c427eda None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:06.551232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:06.551793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:06.552078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:06.552381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:06.554019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:06.602867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:06.647855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:06.649465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cd1f6-7c16-453b-97df-af557805dbd0 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:06.667259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 707/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:07.716709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:07.717265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:07.717265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:07.718633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:07.725544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750be47-0b8e-43dd-aa2d-971cc887de17 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:07.725982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750be47-0b8e-43dd-aa2d-971cc887de17 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:07.726135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750be47-0b8e-43dd-aa2d-971cc887de17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:07.803234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8750be47-0b8e-43dd-aa2d-971cc887de17 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:07.804436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8750be47-0b8e-43dd-aa2d-971cc887de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:07.901680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:08.049092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:08.050665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:08.099824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:08.197155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d827a9c-bde4-4483-82b2-6f2b2557f713 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:08.308552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:08.309163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:08.309438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:08.309705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:08.311350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:08.318716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:08.401483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:08.403118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743af18f-ae27-424b-bbc0-f788242219bc service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:08.420705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 723/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:09.488553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:09.489096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:09.489096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:09.490433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:09.496772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c1f3-3925-4d43-961e-4d61e9582fe5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:09.497257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c1f3-3925-4d43-961e-4d61e9582fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:09.497337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c1f3-3925-4d43-961e-4d61e9582fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:09.572183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-89e1c1f3-3925-4d43-961e-4d61e9582fe5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:09.573387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-89e1c1f3-3925-4d43-961e-4d61e9582fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:09.641419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:09.670779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:09.825363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:09.826859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:09.844748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:09.972053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390535-b3ea-4c0d-9f2a-17c077429104 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:10.060133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:10.086108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:10.086648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:10.086924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:10.087188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:10.088863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:10.175418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:10.177510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369021-7f7a-4346-8d66-23339a2d5575 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:10.195537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 710/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:11.247385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:11.247949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:11.247949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:11.249173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:11.255860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1146d7-5704-44b9-bf6e-eb781a8d0b6e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:11.256318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1146d7-5704-44b9-bf6e-eb781a8d0b6e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:11.256424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1146d7-5704-44b9-bf6e-eb781a8d0b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:11.330642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cb1146d7-5704-44b9-bf6e-eb781a8d0b6e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:11.331830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cb1146d7-5704-44b9-bf6e-eb781a8d0b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:11.372079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:11.426466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:11.575096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:11.576617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:11.721005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfa900-b002-4101-a25f-56887ef33347 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:11.774247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:11.832561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:11.833121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:11.833394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:11.833660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:11.835302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:11.924347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:11.926793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ad0c-fbfb-4046-990f-313c467b178e service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:11.945324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 726/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:12.987858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:12.988286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:12.988416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:12.990295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:12.996349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359d-61fa-4c3d-bd7f-7cda967ea0fe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:12.996761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359d-61fa-4c3d-bd7f-7cda967ea0fe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:12.996938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359d-61fa-4c3d-bd7f-7cda967ea0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:13.072648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bab5359d-61fa-4c3d-bd7f-7cda967ea0fe None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:13.073850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bab5359d-61fa-4c3d-bd7f-7cda967ea0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:13.075882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:13.175033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:13.323745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:13.325260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:13.479856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaccff3-92fc-4f66-95da-8f1aa1e9e0ee None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:13.507361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:13.592145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:13.592670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:13.592945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:13.593222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:13.594871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:13.682842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:13.684456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c57e-4484-4af9-a6be-8b02ff10a538 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:13.701973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 713/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:15.787832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:15.788393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:15.788393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:15.789696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:15.795058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafd4b-74b8-42ca-abc3-73e024999867 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:15.795508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafd4b-74b8-42ca-abc3-73e024999867 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:15.795614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cafd4b-74b8-42ca-abc3-73e024999867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:15.836129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:15.861259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a0cafd4b-74b8-42ca-abc3-73e024999867 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:15.862563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a0cafd4b-74b8-42ca-abc3-73e024999867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:15.958288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:36:16.241460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:16.243048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:16.345837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a52fe-2655-4da5-afcf-99a12a792357 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:16.377434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:16.419077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:16.419641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:16.419931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:16.420202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:16.421804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:16.528848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:16.530313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974afa54-e825-4fbf-a947-52f8eb6f5eec service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:16.548349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 729/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:18.837344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:18.837909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:18.837909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:18.839362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:18.844446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033878-2488-4b2c-b038-818e945a57d4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:18.844873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033878-2488-4b2c-b038-818e945a57d4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:18.845055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033878-2488-4b2c-b038-818e945a57d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:18.911700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bf033878-2488-4b2c-b038-818e945a57d4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:18.912900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf033878-2488-4b2c-b038-818e945a57d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:18.925708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:19.008744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:19.297406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:19.299008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:19.401801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8f0d5-8056-4194-b5d8-fa613e1a876e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:19.414394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:19.475552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:19.476069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:19.476346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:19.476614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:19.478244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:19.584633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:19.586110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa982ac-3f9e-4292-a151-82c64fdea30f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:19.604066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 716/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:22.021317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:22.021881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:22.021881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:22.023218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:22.028447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc528a-2f2a-401b-ba4e-aeba8bfcf719 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:22.028890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc528a-2f2a-401b-ba4e-aeba8bfcf719 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:22.028986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc528a-2f2a-401b-ba4e-aeba8bfcf719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:22.077297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:22.095765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-68bc528a-2f2a-401b-ba4e-aeba8bfcf719 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:22.096983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-68bc528a-2f2a-401b-ba4e-aeba8bfcf719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:22.191824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:22.472769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:22.474342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:22.577398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64083c35-79cb-46b2-922c-0827f2eba705 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:22.616578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:22.650894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:22.651491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:22.651768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:22.652038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:22.653616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:22.765531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:22.767010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c885-d85f-4ad8-8d06-7b9d3bbff664 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:22.784653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 732/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:25.101514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:25.102066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:25.102196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:25.103474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:25.108883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46353-454e-4200-a532-4a5d0d7542c6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:25.109305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46353-454e-4200-a532-4a5d0d7542c6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:25.109459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46353-454e-4200-a532-4a5d0d7542c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:25.175371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d6b46353-454e-4200-a532-4a5d0d7542c6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:25.176585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d6b46353-454e-4200-a532-4a5d0d7542c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:25.196644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:25.272770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:25.561125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:25.562746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:25.666545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b92499-7957-4b2a-a7c2-49d542c9d68b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:25.686604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:25.740304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:25.740894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:25.741180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:25.741456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:25.743105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:25.849624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:25.851016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99813a-d544-473c-ba39-aa9e217441f3 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:25.869372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 719/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:28.156909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:28.157417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:28.157417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:28.158750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:28.164631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1527f-76de-42e8-b7ff-f7a85c26854a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:28.165059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1527f-76de-42e8-b7ff-f7a85c26854a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:28.165186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1527f-76de-42e8-b7ff-f7a85c26854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:28.227141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:28.229995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-04f1527f-76de-42e8-b7ff-f7a85c26854a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:28.231742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-04f1527f-76de-42e8-b7ff-f7a85c26854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:28.327157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:28.613035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:28.614606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:28.721563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16722a30-ba9a-4ff2-b6f4-72835ac230c7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:28.777513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:28.804146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:28.804742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:28.805017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:28.805292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:28.806917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:28.915570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:28.917010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8e52-9432-4dcc-bb55-dc67495b110b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:28.935557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 735/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:31.150573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:31.151108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:31.151226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:31.152497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:31.157853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d7ce-cec0-4fe5-8fd1-74068fbe1296 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:31.158266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d7ce-cec0-4fe5-8fd1-74068fbe1296 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:31.158431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d7ce-cec0-4fe5-8fd1-74068fbe1296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:31.224318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f952d7ce-cec0-4fe5-8fd1-74068fbe1296 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:31.225428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f952d7ce-cec0-4fe5-8fd1-74068fbe1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:31.254593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:31.322680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:31.610967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:31.612508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:31.713832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b4a5-7df2-491a-8eab-828fd97ead7a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:31.742247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:31.786905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:31.787509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:31.787791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:31.788063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:31.789652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:32.012593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:32.014055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9323329-da4c-4b5b-8a9d-a8872d7cccd7 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:32.032682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 722/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:34.215566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:34.216257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:34.216257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:34.217458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:34.222764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffe5e-39dc-49e1-b01d-0c2b6151b6ac None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:34.223293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffe5e-39dc-49e1-b01d-0c2b6151b6ac None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:34.223407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffe5e-39dc-49e1-b01d-0c2b6151b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:34.289614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-769ffe5e-39dc-49e1-b01d-0c2b6151b6ac None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:34.290865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-769ffe5e-39dc-49e1-b01d-0c2b6151b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:34.299063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:34.386678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:36:34.671281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:34.672832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:34.778416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596dfd1-113a-48b3-a427-799dd008f6c9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:34.834413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:34.852888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:34.853489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:34.853767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:34.854066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:34.855660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:34.964434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:34.965878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923566b6-1e39-4632-aab1-846aad2bf7c5 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:34.984647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 738/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:37.174399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:37.174931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:37.175052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:37.176815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:37.182195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace65-ca97-4ef7-88f5-56cf7ad2ba5e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:37.182619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace65-ca97-4ef7-88f5-56cf7ad2ba5e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:37.182723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace65-ca97-4ef7-88f5-56cf7ad2ba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:37.249314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-070ace65-ca97-4ef7-88f5-56cf7ad2ba5e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:37.250510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-070ace65-ca97-4ef7-88f5-56cf7ad2ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:37.289327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:37.349906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:37.634318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:37.635854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:37.740506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c84e5-13e5-4a8b-bbcf-de63d7e42172 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:37.777692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:37.812038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:37.812637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:37.812914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:37.813184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:37.814793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:37.921039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:37.922549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6a5d-3b86-40e5-bcfa-3d0ab0cd050a service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:37.939689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 725/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:40.148712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:40.149264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:40.149264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:40.150631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:40.156047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ec09-a06e-4a8e-ac3b-c67da9b0c955 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:40.156501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ec09-a06e-4a8e-ac3b-c67da9b0c955 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:40.156597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990ec09-a06e-4a8e-ac3b-c67da9b0c955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:40.221055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2990ec09-a06e-4a8e-ac3b-c67da9b0c955 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:40.222318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2990ec09-a06e-4a8e-ac3b-c67da9b0c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:40.240273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:40.318694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:40.609348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:40.610911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:40.712919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b85a86-5cbc-4729-bafc-0f236a1aebf3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:40.781110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:40.788684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:40.789289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:40.789565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:40.789834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:40.791451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:40.899916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:40.901284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7186b-af8f-495a-aab1-aafdda605625 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:40.919621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 741/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:43.071718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:43.072268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:43.072268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:43.073593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:36:43.078859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354166-950e-4b7f-b984-a67ea14c39ab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:43.079260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354166-950e-4b7f-b984-a67ea14c39ab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:43.079409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1354166-950e-4b7f-b984-a67ea14c39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:43.144538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a1354166-950e-4b7f-b984-a67ea14c39ab None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:36:43.145723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a1354166-950e-4b7f-b984-a67ea14c39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:43.192498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:43.242498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:36:43.522621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:36:43.524166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:43.624913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057f7e-638b-430f-a037-0ab7c5b7dcc0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:36:43.672156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:43.697991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:36:43.698596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:36:43.698873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:36:43.699142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:36:43.700722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:36:43.806758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:36:43.808105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5501f-d032-4ef0-b756-0c26db5b862c service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:36:43.826620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 728/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:36:53.240948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=22 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:36:53.824358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=66 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:04.007128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f323-5e1d-4421-a24e-7cc3db2d43a3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:04.007758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f323-5e1d-4421-a24e-7cc3db2d43a3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:04.007758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f323-5e1d-4421-a24e-7cc3db2d43a3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:04.009014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 743/1471] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:04.014562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf391-02a5-404d-8453-896e8998e7c2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:04.014987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf391-02a5-404d-8453-896e8998e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:04.015092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf391-02a5-404d-8453-896e8998e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:04.079774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7d4bf391-02a5-404d-8453-896e8998e7c2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:04.081008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7d4bf391-02a5-404d-8453-896e8998e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:04.178267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 729/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:04.474166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:04.474458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:04.474738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:04.476060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 744/1473] 10.222.0.18 () {54 vars in 966 bytes} [Thu Sep 8 18:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:04.480971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f79bb-15ca-4fa7-8dad-b7ea67734cd9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:04.481289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f79bb-15ca-4fa7-8dad-b7ea67734cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:04.481563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f79bb-15ca-4fa7-8dad-b7ea67734cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:04.561567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-691f79bb-15ca-4fa7-8dad-b7ea67734cd9 None None] MFA Rules not processed for user `6fc5a9468ff5431e972345db08ac876d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:04.562715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-691f79bb-15ca-4fa7-8dad-b7ea67734cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:04.582526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:04.637738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 730/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Thu Sep 8 18:37:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:04.645398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:04.646976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:04.750090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf8c0-e578-4ef0-95cf-cc3bff7ff306 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:04.822362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:04.822900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:04.823180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:04.823454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:04.825052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:04.879250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:04.933896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:04.935358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe766-9551-4cf5-b1b6-efebfdb94e7a service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:04.952812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 745/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:07.173799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:07.174392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:07.174392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:07.175729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 731/1476] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:07.180916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a1ea-9b19-48c0-910f-d8a237742dc3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:07.181334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a1ea-9b19-48c0-910f-d8a237742dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:07.181474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a1ea-9b19-48c0-910f-d8a237742dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:07.246454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6096a1ea-9b19-48c0-910f-d8a237742dc3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:07.247586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6096a1ea-9b19-48c0-910f-d8a237742dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:07.343995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 746/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:07.616156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:07.617624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:07.745331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647f341-758f-4f0a-a959-c2d912ea1e33 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:07.795164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:07.837892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:07.838526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:07.838806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:07.839076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:07.839707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:07.841430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:37:07.841430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:37:07.841430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:37:07.842588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff688ac-ec65-42ef-99ce-95051e7dc309 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:07.861299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 732/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 8 18:37:07 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:37:10.037851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:10.038411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:10.038411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:10.039775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 747/1479] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:10.045023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787c27-e633-4bb5-a978-5e8c41dbd13c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:10.045457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787c27-e633-4bb5-a978-5e8c41dbd13c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:10.045595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787c27-e633-4bb5-a978-5e8c41dbd13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:10.109730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52787c27-e633-4bb5-a978-5e8c41dbd13c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:10.110954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52787c27-e633-4bb5-a978-5e8c41dbd13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:10.205039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 733/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:10.510566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:10.512129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:10.522166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:10.663261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdbbf-db4f-4c06-8ffa-3a2f9a788351 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:10.742124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:10.775857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:10.776395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:10.776670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:10.776941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:10.778547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:10.867502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:10.869073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980585-6a51-42b5-b6a9-e017048af712 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:10.886898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 748/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:13.179438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:13.179999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:13.179999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:13.181313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 734/1482] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:13.186520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2f9b-d223-4643-b3fc-c2164673a81c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:13.186964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2f9b-d223-4643-b3fc-c2164673a81c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:13.187070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2f9b-d223-4643-b3fc-c2164673a81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:13.251116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-643c2f9b-d223-4643-b3fc-c2164673a81c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:13.252231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-643c2f9b-d223-4643-b3fc-c2164673a81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:13.299328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:13.350813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 749/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:13.639458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:13.640998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:13.665034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:13.745129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2f9b-c7e9-4eae-952d-ef98e5e321a7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:13.816259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:13.816854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:13.817160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:13.817438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:13.819043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:13.892527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:13.927441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:13.928901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ec917-e049-4104-8b9b-63d05875e143 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:13.946344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 735/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:16.206263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:16.206843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:16.206843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:16.208177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 750/1485] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:16.213612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf9-a5a9-48d5-96be-7b71488d4505 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:16.214102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf9-a5a9-48d5-96be-7b71488d4505 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:16.214218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf9-a5a9-48d5-96be-7b71488d4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:16.280388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2b0e0cf9-a5a9-48d5-96be-7b71488d4505 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:16.281649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2b0e0cf9-a5a9-48d5-96be-7b71488d4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:16.376845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 736/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:16.661338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:16.662920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:16.770539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b3a8-606b-44d8-9081-063dd0fd2bd8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:16.841672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:16.843442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:16.844235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:16.844532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:16.845004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:16.847043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:16.957155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:16.959138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc420b4-cea4-4dda-90d4-c89401c9e42c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:17.097506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 751/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:19.417648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:19.418211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:19.418211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:19.419563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 737/1488] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:19.424740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafb78-567e-4ad8-a97f-921a11bc98b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:19.425154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafb78-567e-4ad8-a97f-921a11bc98b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:19.425321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafb78-567e-4ad8-a97f-921a11bc98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:19.491180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d7dafb78-567e-4ad8-a97f-921a11bc98b1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:19.492335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d7dafb78-567e-4ad8-a97f-921a11bc98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:19.544660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:19.588055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 752/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:37:19.878423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:19.879991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:19.917244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:19.987587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6a4c-35e5-4c29-94c3-f5e34bda938e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:20.058429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:20.059024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:20.059302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:20.059570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:20.061141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:20.139326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:20.168500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:20.169973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a22d-783b-44eb-b843-2ef3d6c7fc9b service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:20.187465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 738/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:22.539129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:22.539644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:22.539644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:22.540952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 753/1491] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 8 18:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:37:22.546333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1800-2b66-4bba-a705-7b6978510bfc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:22.546752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1800-2b66-4bba-a705-7b6978510bfc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:22.546890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1800-2b66-4bba-a705-7b6978510bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:22.612441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-86db1800-2b66-4bba-a705-7b6978510bfc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:37:22.613680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-86db1800-2b66-4bba-a705-7b6978510bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:22.708756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 739/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 8 18:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:37:23.007197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:37:23.008767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:23.111105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75860c9-cb30-48e0-87b0-5a87a5508bda None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:37:23.187381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:37:23.188013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:37:23.188297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:37:23.188572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:37:23.190199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:37:23.199462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:23.302186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:37:23.303615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4de42-b2d1-4a0d-9905-128fdaef6242 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:37:23.321324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 754/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:37:32.706710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=82 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:37:33.318866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=50 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:58.364358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:58.364880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:58.364880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:58.438391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:38:58.439582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:58.539390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 740/1494] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:38:58.547266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:58.547756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:58.547865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:58.622657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:38:58.623869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:58.720035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 755/1495] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:38:58.724672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:58.725885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:58.737541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439fb4-2f2c-4225-af18-c427e26ee854 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:58.796763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:58.831707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:58.832301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:58.832578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:58.832852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:58.833506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:38:58.833804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:58.834828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:58.834828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:38:58.834828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:38:58.835697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:58.846316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 741/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:38:58.854580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:58.864009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc845ae-0efc-4a0f-a27b-bc0479c5f607 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:58.924939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:58.958520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:58.959117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:58.959392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:58.959656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:58.960300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:58.962050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:58.962050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:38:58.962050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:38:58.963233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:59.017874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 756/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:38:58 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:38:59.022028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:59.023560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:59.056803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1555-1889-4612-9228-f684430d76c9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:59.148548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:59.149143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.149422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.149694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.150362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:59.151364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:59.151364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:38:59.151364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:38:59.152561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:59.194364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 742/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:38:59 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:38:59.198405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:59.199907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:59.261372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad5f4a-6ae6-4d6e-826d-41993710cb5c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:59.344241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:59.356168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:59.356765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.357039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.357301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.357932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:59.358956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:59.358956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:38:59.358956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:38:59.359822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:59.372601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 757/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:38:59.376603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:59.378186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:59.389234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aab457-1b2b-49de-bfe6-1da4c3f62be1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:59.414044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:59.482938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:59.483538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.483817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.484087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.484721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:59.485718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:59.485718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:38:59.485718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:38:59.486622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38987d-0b30-4f68-9771-7ea5f0572dd3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:59.498805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 743/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:38:59.502954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:38:59.504468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:59.538568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d61db-87ed-43ec-84ff-d1b467b7fde6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:38:59.630746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:38:59.631406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.631572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.631845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] PATH_INFO: `/v3/projects/bc057f81a3c64b598b67a8e412ff0df3/users/133567ffb4524293bbbdb6834aedd0ed/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.654425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc057f81a3c64b598b67a8e412ff0df3, user_id=133567ffb4524293bbbdb6834aedd0ed, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:38:59.655444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:38:59.655444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:38:59.655444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:38:59.657359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4f98f-a76e-40b2-81f0-4e443f1eecc0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:38:59.682366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 758/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:38:59 2022] PUT /identity/v3/projects/bc057f81a3c64b598b67a8e412ff0df3/users/133567ffb4524293bbbdb6834aedd0ed/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:38:59.695188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e8faa-37ac-4f7d-82ba-37026e576c18 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.695481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e8faa-37ac-4f7d-82ba-37026e576c18 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.695761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e8faa-37ac-4f7d-82ba-37026e576c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.752249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ad0e8faa-37ac-4f7d-82ba-37026e576c18 None None] MFA Rules not processed for user `133567ffb4524293bbbdb6834aedd0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:38:59.754097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ad0e8faa-37ac-4f7d-82ba-37026e576c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:38:59.829549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 744/1502] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:38:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:38:59.844307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.844595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.844874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.846739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 759/1503] 10.222.0.18 () {54 vars in 964 bytes} [Thu Sep 8 18:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:38:59.851515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065418-0718-42fd-9947-1837119adb74 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:38:59.851810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065418-0718-42fd-9947-1837119adb74 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:38:59.852089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065418-0718-42fd-9947-1837119adb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:38:59.884356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:38:59.929993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-82065418-0718-42fd-9947-1837119adb74 None None] MFA Rules not processed for user `2e694edc3a35429b8a2041261f9459e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:38:59.931191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-82065418-0718-42fd-9947-1837119adb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.004006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 745/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Sep 8 18:38:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:39:00.011690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:39:00.013198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.063033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:00.117188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51b1b-8948-4352-ab5d-5ecaf0b6f589 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:39:00.190109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:39:00.190712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:00.190992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:00.191266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:00.192859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.293166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:39:00.294640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:39:00.298095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:00.312976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 760/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:39:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:39:00.358407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9c4b-c683-43dc-94e6-0b986d5b4683 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:00.358720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9c4b-c683-43dc-94e6-0b986d5b4683 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:00.358996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd9c4b-c683-43dc-94e6-0b986d5b4683 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:00.360305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 746/1506] 10.222.0.18 () {52 vars in 830 bytes} [Thu Sep 8 18:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:39:00.363978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:39:00.365172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.462467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb6b7-22a4-4422-9548-6911aa1605ef service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:39:00.565910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:39:00.566568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:00.566845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:00.567114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] PATH_INFO: `/v3/users/133567ffb4524293bbbdb6834aedd0ed` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:00.580456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133567ffb4524293bbbdb6834aedd0ed)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:39:00.582066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:39:00.582066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:39:00.582066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:39:00.583271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:39:00.593018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:00.650213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133567ffb4524293bbbdb6834aedd0ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:00.650870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133567ffb4524293bbbdb6834aedd0ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:00.664422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133567ffb4524293bbbdb6834aedd0ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:00.687331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133567ffb4524293bbbdb6834aedd0ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:00.687905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133567ffb4524293bbbdb6834aedd0ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:00.703217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 761/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:39:00 2022] DELETE /identity/v3/users/133567ffb4524293bbbdb6834aedd0ed => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:39:00.708283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:00.708740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:00.708858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:00.765598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:39:00.766750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.843124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:00.855442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 747/1508] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:39:00.865469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:39:00.866744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:00.970468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118d69-8043-4d70-aadc-3f9ae1319dd2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:39:01.027773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:01.050586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:39:01.051224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:01.051504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:01.051777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:01.053410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:01.161798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:39:01.163281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f00d22-c6d4-49a1-a23e-19b7a01bede7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:39:01.182430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 762/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:39:01.539513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:39:01.540993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:39:01.553335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875a82-6a4a-4a13-9672-d53760018e2c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:39:01.649612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:39:01.650278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:39:01.650557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:39:01.650828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] PATH_INFO: `/v3/projects/bc057f81a3c64b598b67a8e412ff0df3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:39:01.660931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc057f81a3c64b598b67a8e412ff0df3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:39:01.661970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:39:01.661970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:39:01.661970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:39:01.663155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:39:01.721194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc057f81a3c64b598b67a8e412ff0df3', 'request_id': 'req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:01.730480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc057f81a3c64b598b67a8e412ff0df3', 'request_id': 'req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:01.744812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc057f81a3c64b598b67a8e412ff0df3', 'request_id': 'req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:01.767338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] The token cache is being invalidate because project bc057f81a3c64b598b67a8e412ff0df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:39:01.767624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:01.768631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c1320b41-a0b0-4c20-8dc9-79b5f00d7540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:39:01.769909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 748/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:39:01 2022] DELETE /identity/v3/projects/bc057f81a3c64b598b67a8e412ff0df3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:39:11.180135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=62 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:39:11.765585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:40:32.229742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:32.230352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:32.230352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:32.231560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:32.236416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98201ff-a375-41ad-b6e8-dc6e627ef056 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:32.236810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98201ff-a375-41ad-b6e8-dc6e627ef056 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:32.236993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98201ff-a375-41ad-b6e8-dc6e627ef056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:32.324740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b98201ff-a375-41ad-b6e8-dc6e627ef056 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:32.325915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b98201ff-a375-41ad-b6e8-dc6e627ef056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:32.432183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:32.587014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:32.589125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:32.707851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56879-91bf-422e-b8e7-df70784d1879 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:32.714173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:32.714782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:32.715061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:32.715352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:32.723776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:32.725348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491fb4-923a-474e-baab-c6e303f47057 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:32.735408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 764/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:33.807814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91739b-0749-4f8d-82e2-bdfcffe5616b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:33.808374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91739b-0749-4f8d-82e2-bdfcffe5616b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:33.808374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91739b-0749-4f8d-82e2-bdfcffe5616b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:33.809695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:33.815640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ac-3d1e-45d6-99c8-51aaed8ae472 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:33.816041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ac-3d1e-45d6-99c8-51aaed8ae472 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:33.816323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ac-3d1e-45d6-99c8-51aaed8ae472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:33.836175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-05ec16ac-3d1e-45d6-99c8-51aaed8ae472 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:33.837402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-05ec16ac-3d1e-45d6-99c8-51aaed8ae472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:33.845188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:33.996245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91739b-0749-4f8d-82e2-bdfcffe5616b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:34.011403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91739b-0749-4f8d-82e2-bdfcffe5616b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:34.018025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:34.018631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:34.018915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:34.019192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:34.029648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:34.032357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e9d4d-cac5-4e07-a6cf-9d68a7ae2e1c service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:34.047332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 751/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:34.460475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d2d-9efd-494f-ad74-4e5c4d854712 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:34.460760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d2d-9efd-494f-ad74-4e5c4d854712 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:34.461033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d2d-9efd-494f-ad74-4e5c4d854712 None None] PATH_INFO: `/v3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:34.462331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 766/1517] 10.222.0.42 () {54 vars in 925 bytes} [Thu Sep 8 18:40:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:40:34.469292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c02f7-8f43-40a9-9a17-b5f196ab0889 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:34.469769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c02f7-8f43-40a9-9a17-b5f196ab0889 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:34.470077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c02f7-8f43-40a9-9a17-b5f196ab0889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:34.529167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3d8c02f7-8f43-40a9-9a17-b5f196ab0889 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:34.530404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3d8c02f7-8f43-40a9-9a17-b5f196ab0889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:34.547353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:40:34.600876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 752/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 8 18:40:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:38.182309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271694-1927-4c5f-8396-cefd787bbcce None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:38.182762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271694-1927-4c5f-8396-cefd787bbcce None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:38.182865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271694-1927-4c5f-8396-cefd787bbcce None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:38.184239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 767/1519] 10.222.0.18 () {54 vars in 961 bytes} [Thu Sep 8 18:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:38.189121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049f2b-73d2-4a3d-a300-82079ab9e558 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:38.189548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049f2b-73d2-4a3d-a300-82079ab9e558 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:38.189670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049f2b-73d2-4a3d-a300-82079ab9e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:38.209263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c5049f2b-73d2-4a3d-a300-82079ab9e558 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:38.210479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c5049f2b-73d2-4a3d-a300-82079ab9e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:38.218756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 753/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Sep 8 18:40:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:40:38.226157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271694-1927-4c5f-8396-cefd787bbcce None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:38.239555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271694-1927-4c5f-8396-cefd787bbcce None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:38.245064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:38.245654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:38.245931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:38.246230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:38.254339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:38.256549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb82d3-9c05-4adb-a5cf-65790b8f7eab service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:38.265903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 768/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:45.522500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb7b4-ee95-4837-83d0-4fec93e322eb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:45.523088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb7b4-ee95-4837-83d0-4fec93e322eb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:45.523088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb7b4-ee95-4837-83d0-4fec93e322eb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:45.524374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:45.530544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b12e54-f54e-41b9-8a76-fc2aad5c3216 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:45.530975 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b12e54-f54e-41b9-8a76-fc2aad5c3216 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:45.531097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b12e54-f54e-41b9-8a76-fc2aad5c3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:45.550142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b0b12e54-f54e-41b9-8a76-fc2aad5c3216 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:45.551337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0b12e54-f54e-41b9-8a76-fc2aad5c3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:45.559610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:45.713122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb7b4-ee95-4837-83d0-4fec93e322eb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:45.727104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb7b4-ee95-4837-83d0-4fec93e322eb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:45.732349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:45.732939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:45.733283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:45.733487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:45.741888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:45.743474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cd6c-f21c-4e6f-894e-96db796d8f0c service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:45.752647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 755/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:46.813423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1f4f-b745-4d30-a1ae-6563547794f2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:46.814019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1f4f-b745-4d30-a1ae-6563547794f2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:46.814019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1f4f-b745-4d30-a1ae-6563547794f2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:46.815367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 18:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:46.821733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc155-98e7-4185-ba01-e982a0f98ba5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:46.822157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc155-98e7-4185-ba01-e982a0f98ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:46.822311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc155-98e7-4185-ba01-e982a0f98ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:46.841738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9dacc155-98e7-4185-ba01-e982a0f98ba5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:46.842957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9dacc155-98e7-4185-ba01-e982a0f98ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:46.850898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 18:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:46.999510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1f4f-b745-4d30-a1ae-6563547794f2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:47.014559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1f4f-b745-4d30-a1ae-6563547794f2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:47.020332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:47.020953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:47.021236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:47.021512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:47.030932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:47.032736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994451f0-7299-497d-bb54-788b35ee369f service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:47.043231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 771/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:51.268148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:51.268672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:51.268672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:51.270055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:51.275326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7f7-277a-45f6-afd0-fb0f20fa8a50 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:51.275729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7f7-277a-45f6-afd0-fb0f20fa8a50 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:51.275876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7f7-277a-45f6-afd0-fb0f20fa8a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:51.295507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-eeebe7f7-277a-45f6-afd0-fb0f20fa8a50 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:51.296697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-eeebe7f7-277a-45f6-afd0-fb0f20fa8a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:51.305299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:40:51.613049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:51.614829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:51.693339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a07d86-b300-4b61-8304-dbf7a2069e0a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:51.696867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:51.697469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:51.697749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:51.698056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:51.706761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:51.708179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553ff1-935b-48bf-9f97-6be1063509f1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:51.717984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 758/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:53.853918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7b6d-5fb1-4371-a060-ed2da149b43b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:53.854513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7b6d-5fb1-4371-a060-ed2da149b43b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:53.854513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7b6d-5fb1-4371-a060-ed2da149b43b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:53.855875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:53.861206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdd0-3a21-4881-a4b8-d4d02d23f0ba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:53.861609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdd0-3a21-4881-a4b8-d4d02d23f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:53.861763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbdd0-3a21-4881-a4b8-d4d02d23f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:53.882155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-665cbdd0-3a21-4881-a4b8-d4d02d23f0ba None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:53.883355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-665cbdd0-3a21-4881-a4b8-d4d02d23f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:53.891376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:54.186245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7b6d-5fb1-4371-a060-ed2da149b43b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:54.196849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7b6d-5fb1-4371-a060-ed2da149b43b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:54.201242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:54.201838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:54.202152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:54.202428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:54.211179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:54.212627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debdb51-d381-402f-befb-e5d024cce5ff service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:54.221908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 774/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:40:57.751741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:57.752232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:57.752392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:57.754187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:40:57.760017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4242-6df5-411b-bbb1-66fb953db3ea None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:57.760460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4242-6df5-411b-bbb1-66fb953db3ea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:57.760563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4242-6df5-411b-bbb1-66fb953db3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:57.780822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e93f4242-6df5-411b-bbb1-66fb953db3ea None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:40:57.782033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e93f4242-6df5-411b-bbb1-66fb953db3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:57.790309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:40:58.096046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:40:58.097691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:40:58.161097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:40:58.174225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46a79b-8653-4e5e-ba4e-d52237e2ba62 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:40:58.177711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:40:58.178334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:40:58.178613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:40:58.178883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:40:58.187496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:40:58.188909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6877c1-77ba-43f8-9d29-6ba305df0fea service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:40:58.198811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 761/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:41:00.310906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:41:00.311374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:41:00.311572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:41:00.312813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 18:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:41:00.317910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facc5e-28ff-455a-a57c-f5a557d8cb77 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:41:00.318390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facc5e-28ff-455a-a57c-f5a557d8cb77 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:41:00.318499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facc5e-28ff-455a-a57c-f5a557d8cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:41:00.337444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-93facc5e-28ff-455a-a57c-f5a557d8cb77 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:41:00.338652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-93facc5e-28ff-455a-a57c-f5a557d8cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:41:00.346368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 18:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:41:00.644282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:41:00.646519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:41:00.659378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322e79-6ed2-4a3b-b6e1-5b70acbc2d44 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:41:00.663772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:41:00.664362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:41:00.664639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:41:00.664911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:41:00.673875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:41:00.675346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6fad7-71ab-49a5-b0bd-68e3025178ad service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:41:00.685241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 777/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:41:10.332713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=11 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:41:10.681095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:28.829073 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4b5c-93c5-4a17-bdf3-f1b33bdd6128 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.829727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4b5c-93c5-4a17-bdf3-f1b33bdd6128 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.829727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4b5c-93c5-4a17-bdf3-f1b33bdd6128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:28.854293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-40cd4b5c-93c5-4a17-bdf3-f1b33bdd6128 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:28.855632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-40cd4b5c-93c5-4a17-bdf3-f1b33bdd6128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:28.870068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 763/1540] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:28.879497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573970-fd2a-4270-a2ce-9f04905fbab2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.880048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573970-fd2a-4270-a2ce-9f04905fbab2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.880048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573970-fd2a-4270-a2ce-9f04905fbab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:28.902917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.903281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.903467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:28.918576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-30573970-fd2a-4270-a2ce-9f04905fbab2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:28.919820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-30573970-fd2a-4270-a2ce-9f04905fbab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:28.937374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:28.939539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:28.946280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 778/1541] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:28.947696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aefd00-ca44-45c0-903d-17b6d7b998d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.947945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aefd00-ca44-45c0-903d-17b6d7b998d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.948225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aefd00-ca44-45c0-903d-17b6d7b998d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:28.962093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 764/1542] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:28.962982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:28.978460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845fa14-a7a9-4df8-8a54-94ffe44c9ccb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:28.979071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-31aefd00-ca44-45c0-903d-17b6d7b998d0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:28.980314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-31aefd00-ca44-45c0-903d-17b6d7b998d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:28.997729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 779/1543] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:28.998657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:28.999212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.999354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:28.999537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.999648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:28.999814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:28.999918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.000486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.000796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.002476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63397d-ee6c-4856-834c-9bbe99bcb73b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.024974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 765/1544] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.026104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.026398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.026682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.039124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.040348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.056290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.057535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.060802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 780/1545] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.061443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.078237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 766/1546] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.080396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eeca3-b69a-4e32-9521-c2276ca4ac07 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.083015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.098778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.099417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.099699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.100772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.100946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4819fc2-a556-48ff-9014-2cae1b1e8e22 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.101427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.103445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6a6c-3548-4a79-afff-2b4033f6f680 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.117852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.118691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.118976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.119252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.119927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.120231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.121896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.156500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 767/1547] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.159715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.178236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1887-f45a-4ab7-92da-5945f6eec911 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.181828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 781/1548] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.183227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.183517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.183792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.186328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.187188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.187571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.187940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.188711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.189115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.190945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.220100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 768/1549] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.221249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.229321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.230816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.238848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667123-001e-459c-9d60-153cdfeb5296 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.311959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 782/1550] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.313523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.323896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b23e8-c436-4e4e-8b08-baca00b85b75 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.329739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.330966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.331360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.332414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.333623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.335848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:29.335848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:42:29.335848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:42:29.337092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.353717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.354727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.355236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.355815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.356865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.358202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:29.358202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:42:29.358202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:42:29.359993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c5be-3f8d-4f96-bd28-971d3ede742c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.366304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 783/1551] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.366304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.376358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd414ae6-022d-439f-ab62-9f4880166dda admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.382104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.383337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.383629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.384087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.384690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.390073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa870e-7af1-4612-87c7-12212f435a98 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.406523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 769/1552] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.407848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced006d-bda9-4ff6-aed9-a6a6a3de7524 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.408230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced006d-bda9-4ff6-aed9-a6a6a3de7524 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.408395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced006d-bda9-4ff6-aed9-a6a6a3de7524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.421136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 784/1553] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.422611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.423092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.423368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.430369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9ced006d-bda9-4ff6-aed9-a6a6a3de7524 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.431749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9ced006d-bda9-4ff6-aed9-a6a6a3de7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.442239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.443411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.490327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 770/1554] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.491910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4843-9c7f-465d-8fea-0dd874f17991 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.492385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4843-9c7f-465d-8fea-0dd874f17991 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.492675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4843-9c7f-465d-8fea-0dd874f17991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.507688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 785/1555] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.508598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.514216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d3aa4843-9c7f-465d-8fea-0dd874f17991 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.515492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d3aa4843-9c7f-465d-8fea-0dd874f17991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.519118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1b7a8-4199-4248-88fe-779902d16c1d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.524105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 771/1556] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.525260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.525541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.525813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.528198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.528851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.529093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.529376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.530051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.531664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e20b41-4e35-406c-b638-75193c0168bb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.538064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:29.546886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 786/1557] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.546886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5545-9145-4131-a596-83d9920cc892 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.547191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.547715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5545-9145-4131-a596-83d9920cc892 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.547715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5545-9145-4131-a596-83d9920cc892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.548085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.554970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 772/1558] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.555727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.565167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35eac-46cc-4b83-b9b9-471215cb8574 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.566105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-758b5545-9145-4131-a596-83d9920cc892 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.567305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-758b5545-9145-4131-a596-83d9920cc892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.570211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.570798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.571077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.571343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.571962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.573857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61f2a-b218-4eda-848d-53e6a72be70a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.575754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 787/1559] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.576494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b5545-9145-4131-a596-83d9920cc892 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.586085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:29.588905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b5545-9145-4131-a596-83d9920cc892 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.594324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.594879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.595179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.595437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.596062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.597986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa0065-c04f-4dfe-9355-8827bd2e32b1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.601328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 773/1560] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.601328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.601328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.601328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.619876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 788/1561] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.620818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.621299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.621589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.621861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.622023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.630497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 774/1562] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.631868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.641336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d8d8a-bba1-4c3d-a902-43cb50a13fba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.645001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.645842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.646514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.647338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.647630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.647899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.648530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.648830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.650452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae409-8218-42e1-98dd-fadbceba9011 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.655530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 789/1563] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.658783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.662690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 775/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.663919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c67e3-e270-4721-a129-36a1e784670e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.664198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c67e3-e270-4721-a129-36a1e784670e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.664471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c67e3-e270-4721-a129-36a1e784670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.669063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a068f65-aac7-4f70-aa51-577b86eaa189 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.674547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.675147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.675429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.675703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.676373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.678039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb14c87-9ea2-4d6a-aa16-a8f57bff43e5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.683421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-583c67e3-e270-4721-a129-36a1e784670e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.684655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-583c67e3-e270-4721-a129-36a1e784670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.688419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 790/1565] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.689589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.689873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.690210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.696481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 776/1566] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.697998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c67e3-e270-4721-a129-36a1e784670e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.708009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c67e3-e270-4721-a129-36a1e784670e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.711547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:29.712731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:29.713198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.713824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.714139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.714415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.715048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.716619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.720632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 791/1567] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:29.721397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.730006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 777/1568] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.730828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d46b9a-2b85-48e6-aeea-c1ad650de4b9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.730966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.736067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.736658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.736938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.737206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.737838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.739451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.741097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeececf9-6f20-499e-9b84-e9f50c6b5d6e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.745580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.746199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.746483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.746757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.747384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.747687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.749243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.752770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 792/1569] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.752770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.768668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 778/1570] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.768668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.768928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd5a69-c46d-477d-ad9c-0ef2cd902f45 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.768928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.769439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.769836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.770017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.770650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.770950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.772234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:29.772234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:42:29.772234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:42:29.772455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72b2d-b8a4-44de-b1ac-c96d25949cbb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.773093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.777067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.777689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.777992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.778268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.778883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.780776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.785467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 793/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.786303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.795896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8cbe3-3128-411d-95e5-184ae597bb71 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.801317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.801995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.802277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.802553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] PATH_INFO: `/v3/projects/f871527a6b5c4b58a972839c00fff8d0/users/f4800b1e92614f72981cbf6bb4279aa6/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.809087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 779/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:29.809899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.818455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f871527a6b5c4b58a972839c00fff8d0, user_id=f4800b1e92614f72981cbf6bb4279aa6, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.821796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.834654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 794/1573] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:29 2022] PUT /identity/v3/projects/f871527a6b5c4b58a972839c00fff8d0/users/f4800b1e92614f72981cbf6bb4279aa6/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:29.835617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.874010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39638b0-141e-4cce-90ad-1b004d812c32 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.898288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03834fc3-8cbc-40c1-a191-ffadd9ece210 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.902977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.903585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.903866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.904138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.904803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.905107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.906777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.918804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 795/1574] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.919610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.929831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec55e8-3888-4b0e-a360-1bf254c99c67 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.934401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.934977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.935289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.935560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.936185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.937747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.938091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.938708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.938985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.939290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.939937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:29.940269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.941874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.948878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 796/1575] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.948878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.954199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 780/1576] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:29.954903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.961832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50c9f-76fa-4d1d-b3e1-cd017bdc2140 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.966494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.967089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.967371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.967643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.968292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.969880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.970216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff39a4-52a0-497b-bcc6-d1f94d4cb7fa admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.974781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.975394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.975669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.975943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.976560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:29.978459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:29.979777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 797/1577] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:29.980614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:29.991678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191616b8-452a-49f1-ae64-ce36c4d4f309 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:29.996370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:29.996981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:29.997277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:29.997531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:29.998219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.000467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad74e3-77ba-4de0-82a7-069cd8755236 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.009909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 781/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.009909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.012721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.031066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 798/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:29 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.032482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.032768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.033042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.051598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:30.052810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:30.062220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.076420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c64d-898b-4ec0-8507-fe47b5f157c0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.113514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 799/1580] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:30.114280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.123880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074e456-4b9f-4f1d-a4d0-0d89e7e3cc38 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.128628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.129157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.129441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.129714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.130377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.132351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.134470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.135091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.135377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.135656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.136308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.138243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.163330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 782/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.163330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.163626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 800/1582] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.165472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.171834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5283d-a3af-4cf0-9e07-743b609091d2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.227296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd00ad-38e5-444d-a656-3419301b19ec admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.227502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.227954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.228240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.228519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] PATH_INFO: `/v3/projects/044f61601f9e4f5b99bcb463ff5dec78/users/bdc738e190f149a19a2ca496e4981f26/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.231980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.232575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.232853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.233128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.233751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.235687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.244298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=044f61601f9e4f5b99bcb463ff5dec78, user_id=bdc738e190f149a19a2ca496e4981f26, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.245333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:30.245333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:42:30.245333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:42:30.247306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.261628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 783/1583] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:30 2022] PUT /identity/v3/projects/044f61601f9e4f5b99bcb463ff5dec78/users/bdc738e190f149a19a2ca496e4981f26/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:30.262472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.274008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 801/1584] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.274008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.290373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.329126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944d37-e733-4969-8405-10ef420edbbf admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.342944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a87b2c-9c3e-49ff-923a-a1321c3096b9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.347656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.348262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.348546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.348820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.349461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.352061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.373869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 802/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.374565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.384779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395f23b-14f1-4a97-b2c9-cde550f7b10d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.389445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.390175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.390459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.390736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.391363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.392562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.393227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.393331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.393514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.393798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] PATH_INFO: `/v3/projects/500d3cd7860b44609694609ad5f39bef/users/1821bb1fc7124392bcfb6417119a42cd/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.401432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.408990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=500d3cd7860b44609694609ad5f39bef, user_id=1821bb1fc7124392bcfb6417119a42cd, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.411689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.420198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 803/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.420863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.427809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 784/1587] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:30 2022] PUT /identity/v3/projects/500d3cd7860b44609694609ad5f39bef/users/1821bb1fc7124392bcfb6417119a42cd/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:30.429269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.488710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e533d2-e3c9-47e1-9fbe-32cc56fa0b8e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.493707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe12a-f338-4bbc-be4f-c878f035a27e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.498379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.499019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.499299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.499574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.500420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.502040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.511905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 785/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.512700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.523041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75941dc5-12e8-4eaa-80f5-4bbc4ef61cba admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.531668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.532261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.532539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.532809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.533527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.535458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab828a-52ce-487a-bd67-41ba0b42ef81 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.540829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.541444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.541721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.542030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.551883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.553320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.559907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 786/1589] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/users => generated 301 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.562788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 804/1590] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:30.563563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.564522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.564821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.565101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.572452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bac83-0bcc-4dc8-8263-7bd5d146cb26 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.577102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.577692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.577989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.578259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.578877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.580775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.601932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] MFA Rules not processed for user `bdc738e190f149a19a2ca496e4981f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:30.603231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:30.604894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 805/1591] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.605634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.617680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb151d-331a-4a49-b0c3-9b79f2a64d8e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.623022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.624144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.624822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.625136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.625665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.626736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.629009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.641700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 806/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.642577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.654674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29f48-d2f7-4f71-a693-971c1f691ba3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.660689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.661479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.661958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.662256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.663586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.665239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfaeab-8181-4306-b338-1103b5a6ad80 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.676869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 807/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.678513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.678978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.679401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.685865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 787/1594] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:30.686963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.698944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa180-135a-44d3-b1f8-2a28ade720b9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.704656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.705267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.705622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.705934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.706662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.708357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.717600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] MFA Rules not processed for user `1821bb1fc7124392bcfb6417119a42cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:30.718960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:30.719924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 788/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.720611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.731091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5546-cd40-4344-9109-9ce40567ae62 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.735896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.736513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.736787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.737057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.737704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.739318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.752593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 789/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.752593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.761768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f196ee-22fe-4a1d-89fc-d99fd0625f06 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.768022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.768630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.768914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.769197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.769861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.772297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.788435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 790/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.788435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.804094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d8db-227f-4611-8da0-68bfd279680c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.807078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.807715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.807995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.808266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.808911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.811036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:30.811196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.819080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 808/1598] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:30.820959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.831824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 791/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.831824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.837262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eec1c-ea57-454c-80ef-2714077ce64c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.841407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ab60-6c89-4b19-b4cc-0d1636c8ec95 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.842360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.843123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.843328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.843727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.844441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.846273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.848739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.850510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.850919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.851944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.852863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.855821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.860614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 809/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:30.861767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.875626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2fc3-e2ed-4b99-8798-a097c3c6ce7f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:30.882078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:30.883157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:30.883775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:30.884346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] PATH_INFO: `/v3/projects/bea9e83441744745b716e4554911e465/users/06577b267fec462c87bfff97abe065de/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:30.894524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 792/1601] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:30 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:30.895466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.906778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea9e83441744745b716e4554911e465, user_id=06577b267fec462c87bfff97abe065de, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:30.910116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:30.948145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 810/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:30 2022] PUT /identity/v3/projects/bea9e83441744745b716e4554911e465/users/06577b267fec462c87bfff97abe065de/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:30.949442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:30.983167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e11e-1ba1-4c4b-a465-3423d5707bd9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.044717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a07d-56d8-4be3-a0c9-b75fe696079b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.049768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.049921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.050574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.050968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.051225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.051376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.051639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.051999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.052304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.053668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.054077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.054877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.056932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:31.067096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 793/1603] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:31.068312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.073763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 811/1604] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:31.074930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.080366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe01cc-67b1-4339-90c1-3317e5b10882 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.085783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc416-53bd-437a-9d86-b8f1e53b0a0a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.086048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.086702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.086982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.087372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] PATH_INFO: `/v3/projects/1cc6d3d2113c41c19e584273e8782b29/users/7eef856911e747b6830bbbc1c91439c1/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.091007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.091784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.092158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.092533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] PATH_INFO: `/v3/projects/9b0ad289e3494efa9a80ab5ec7593c7b/users/3b06d6cf9b694708a25c0c974558c29d/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.103157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc6d3d2113c41c19e584273e8782b29, user_id=7eef856911e747b6830bbbc1c91439c1, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.105773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79ba7f-fe48-42d3-920c-fcf666cfac82 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.108534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0ad289e3494efa9a80ab5ec7593c7b, user_id=3b06d6cf9b694708a25c0c974558c29d, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.111538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196afd9f-795a-4eaf-8750-6358c8e12fc0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.121526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 794/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:31 2022] PUT /identity/v3/projects/1cc6d3d2113c41c19e584273e8782b29/users/7eef856911e747b6830bbbc1c91439c1/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:31.122830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877872-9826-4088-b2fb-03dda07fb12e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.123113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877872-9826-4088-b2fb-03dda07fb12e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.123388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c877872-9826-4088-b2fb-03dda07fb12e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.124811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 795/1606] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 8 18:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:31.125282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c877872-9826-4088-b2fb-03dda07fb12e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.128273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 812/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:31 2022] PUT /identity/v3/projects/9b0ad289e3494efa9a80ab5ec7593c7b/users/3b06d6cf9b694708a25c0c974558c29d/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:31.129531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.129819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.130537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.151739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.152898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.202380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c877872-9826-4088-b2fb-03dda07fb12e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.207886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.208416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.208831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.209223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.210602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.212675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.218990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 813/1608] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.219827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.229800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7535-ccbf-41e0-9a0b-f337d6e6ad2b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.236384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.237161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.237441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.237723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] PATH_INFO: `/v3/projects/0c1b9bb88f76424ab4c66c37ae40eb3f/users/2a0139649f62413dadf9a658f438e4a9/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.246793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 796/1609] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:31.247723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.259891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1b9bb88f76424ab4c66c37ae40eb3f, user_id=2a0139649f62413dadf9a658f438e4a9, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.262084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b803f6-caf1-4c3e-bb16-2f303cdaced6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.262694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a430a-da74-4a6f-a839-477f045e9dbc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.268786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.269472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.269876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.270191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] PATH_INFO: `/v3/projects/d935fc5cbb2c4e0287afa743a9bfc2ca/users/c2ade7e02b814dfab184622fbe3c3557/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.284733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 814/1610] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:31 2022] PUT /identity/v3/projects/0c1b9bb88f76424ab4c66c37ae40eb3f/users/2a0139649f62413dadf9a658f438e4a9/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:31.295636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c589-3761-49f5-b60c-e6c1afc07e4f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.295636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c589-3761-49f5-b60c-e6c1afc07e4f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.295636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c589-3761-49f5-b60c-e6c1afc07e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.296051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d935fc5cbb2c4e0287afa743a9bfc2ca, user_id=c2ade7e02b814dfab184622fbe3c3557, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.298541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67377c1d-b018-4f25-bd9b-754a53e0d391 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.311782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5207c589-3761-49f5-b60c-e6c1afc07e4f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.313142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5207c589-3761-49f5-b60c-e6c1afc07e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.316200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 797/1611] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:31 2022] PUT /identity/v3/projects/d935fc5cbb2c4e0287afa743a9bfc2ca/users/c2ade7e02b814dfab184622fbe3c3557/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:31.317767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.317996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.318257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.322044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:31.360945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] MFA Rules not processed for user `7eef856911e747b6830bbbc1c91439c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.362471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.429083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 815/1612] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.429083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69559-67bd-47ef-9b27-2ccf865a1f8f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.429083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69559-67bd-47ef-9b27-2ccf865a1f8f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.429083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69559-67bd-47ef-9b27-2ccf865a1f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.448338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 798/1613] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.449376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.484049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2ce69559-67bd-47ef-9b27-2ccf865a1f8f None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.485842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:31.486722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ce69559-67bd-47ef-9b27-2ccf865a1f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.518792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51857f1f-c60f-4adb-b24a-e21048d3c18d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.524388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.525501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.525989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.526455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.538533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.540635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.556961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 799/1614] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:31.558256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.567671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf74d1-96ed-4452-b2a3-ad2f1ce04e1e service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.574356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.575848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.576137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.576411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.577151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.578975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78d4cc-99de-428a-b6d3-19bb309145cd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.582742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 816/1615] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.584652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.584945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.586148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.608580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 800/1616] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:31.610749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.611307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.611652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.623595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] MFA Rules not processed for user `2a0139649f62413dadf9a658f438e4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.625325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.637997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:31.639654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.650641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 801/1617] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.652022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.654354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:31.675689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d8639-af13-4bff-a836-2efe6d4b5b1f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.682208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.683758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.684196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.684939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.699285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.701024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.707238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 817/1618] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:31.708167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.716452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 802/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:31.717640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.720746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc01fd-4d23-489f-a1c2-42f25b81a370 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.727808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.728771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.729060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.729382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.730239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.732549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.732698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a8a0-bd0d-40c6-abb9-0d4ceff42b6f service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.740161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.741582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.741863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.742166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:31.766310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:31.792129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 818/1620] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:31 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:31.796283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.823425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:31.825333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:31.840367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 803/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:31.841570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:31.855195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d80b0-43c4-4088-8537-832860189de2 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:31.931427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:31.932139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:31.932617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:31.932840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.019440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:32.037212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.040106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.054535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 804/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:32.056240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.069226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904a669-cae6-40a7-a2c4-090a48f72718 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.069403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf685dd4-c0e0-4411-ad7c-586414128b9b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.078791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.079809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.080032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.080478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.081147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.083227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.088236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.091427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.094491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.095771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] PATH_INFO: `/v3/projects/aae819a94b254958b8bbb85ba91b7b13/users/6468591cc7d24a28bfaf0a3197c365be/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.132492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 805/1623] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:32 2022] POST /identity/v3/projects => generated 403 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:32.134117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.150203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae819a94b254958b8bbb85ba91b7b13, user_id=6468591cc7d24a28bfaf0a3197c365be, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.162056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.201712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 819/1624] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:31 2022] PUT /identity/v3/projects/aae819a94b254958b8bbb85ba91b7b13/users/6468591cc7d24a28bfaf0a3197c365be/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:32.207972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.289095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bafb18-8755-4246-a45b-8f9829e7b0bb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.442026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e909d-3393-4450-8374-4575291d5902 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.450385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.452321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.461104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.462738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.463593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.464558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.466846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.467235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.467601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.470469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.472201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.476714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.544395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 820/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:32 2022] POST /identity/v3/users => generated 308 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:32.544395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.546069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 806/1626] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:32 2022] POST /identity/v3/users => generated 295 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:32.547256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.559468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab25e-3bb9-4bcb-86a5-2e544f6a782a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.567228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.567970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.569529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.570343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.571580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863421ac-b7aa-4ada-9d1d-6d520f20b998 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.580576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.582794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.583505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.584138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.584989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.585265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.585916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.587538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.603255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 807/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:32.604487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.610979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 821/1628] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:32.614500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.628018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cabb-3bfc-493d-abc4-34b212265a45 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.634922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533cdec-4f7c-4047-ba2c-17928d75a3f0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.635608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.636338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.636757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.637790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.639135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.640907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.647734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.648412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.648696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.648971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] PATH_INFO: `/v3/projects/faeca9bf05db441db38597f5b66eaa3e/users/66a23762204d48738dde31f38f9a81b1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.655874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 808/1629] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:32.657464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.692432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeca9bf05db441db38597f5b66eaa3e, user_id=66a23762204d48738dde31f38f9a81b1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.696863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67faf5-ed8d-4221-966a-5e1b1f24ed61 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.701500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4454-dc25-4031-b208-52366bd6f31e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.716305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.716947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.717403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.717853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] PATH_INFO: `/v3/projects/aae819a94b254958b8bbb85ba91b7b13/users/6468591cc7d24a28bfaf0a3197c365be/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.721669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 822/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:32 2022] PUT /identity/v3/projects/faeca9bf05db441db38597f5b66eaa3e/users/66a23762204d48738dde31f38f9a81b1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:32.723120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a69d-9db2-4be6-a643-e0df4cbbfa50 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.723387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a69d-9db2-4be6-a643-e0df4cbbfa50 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.723663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a69d-9db2-4be6-a643-e0df4cbbfa50 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.725571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae819a94b254958b8bbb85ba91b7b13, user_id=6468591cc7d24a28bfaf0a3197c365be, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.726787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 823/1631] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 8 18:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:32.727533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4a69d-9db2-4be6-a643-e0df4cbbfa50 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.732550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.764176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 809/1632] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:32 2022] PUT /identity/v3/projects/aae819a94b254958b8bbb85ba91b7b13/users/6468591cc7d24a28bfaf0a3197c365be/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:32.766286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:32.811166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:32.832527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:32.871137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c90ffb-26d6-4386-9293-073de637c101 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.877896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.878608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.879963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.880250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.880914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:32.883275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a689-92e2-4d79-8c9f-02e2072d74c9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:32.914420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 810/1633] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:32.914420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.914420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.914420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:32.948289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4a69d-9db2-4be6-a643-e0df4cbbfa50 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:32.951175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:32.952552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:32.971237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:32.972170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:32.972452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:32.972924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] PATH_INFO: `/v3/projects/170d20c473ab4f8e91b04b0962cabf67/users/43ff7a877c874c95a69a09f1ebc3871b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.021501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=170d20c473ab4f8e91b04b0962cabf67, user_id=43ff7a877c874c95a69a09f1ebc3871b, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.024270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6180-b021-46ba-ae94-fb20b91c4bad admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.051045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 824/1634] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:32 2022] PUT /identity/v3/projects/170d20c473ab4f8e91b04b0962cabf67/users/43ff7a877c874c95a69a09f1ebc3871b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:33.052327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.052612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.052894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.122112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 811/1635] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:42:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:33.124079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:33.131367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] MFA Rules not processed for user `6468591cc7d24a28bfaf0a3197c365be`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:33.133201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:33.171824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d30ee-a1cc-485a-913e-e953b35702bc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:33.352055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 825/1636] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:33.352055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:33.417098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:33.419478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.420563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.421154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] PATH_INFO: `/v3/projects/faeca9bf05db441db38597f5b66eaa3e/users/66a23762204d48738dde31f38f9a81b1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.428529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeca9bf05db441db38597f5b66eaa3e, user_id=66a23762204d48738dde31f38f9a81b1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.435303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.476143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 812/1637] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:33 2022] PUT /identity/v3/projects/faeca9bf05db441db38597f5b66eaa3e/users/66a23762204d48738dde31f38f9a81b1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:33.476143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:33.550533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8d8ae-30c4-455a-b413-133a9f5e22fb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:33.597913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c05ff9-ae06-4881-a99a-9d80e1413201 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:33.606784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:33.608155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.608155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.608155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.616892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:33.643684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:33.659690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:33.661679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.662528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.663232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.664265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.667376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.685721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 826/1638] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:33.687016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:33.705090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9dbf-be49-470d-a6df-b1932c24621d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:33.710948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:33.716768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.718077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.718790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.766203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.767665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01420b-18d3-48ca-a3a5-6a6b6a2da53f service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.795812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 813/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:33.810683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.810982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.811256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.861209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.865127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.879709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 827/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:33.880752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:33.908446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d315e74-eae2-4d2f-9400-9a285deedee3 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:33.916735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] MFA Rules not processed for user `66a23762204d48738dde31f38f9a81b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:33.918282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:33.927452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:33.928874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:33.931773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:33.932204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] PATH_INFO: `/v3/projects/170d20c473ab4f8e91b04b0962cabf67/users/43ff7a877c874c95a69a09f1ebc3871b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:33.939826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170d20c473ab4f8e91b04b0962cabf67, user_id=43ff7a877c874c95a69a09f1ebc3871b, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:33.947858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09842503-6b8a-4ead-a00f-5e4a20da3c85 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:33.995568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 828/1641] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:33 2022] PUT /identity/v3/projects/170d20c473ab4f8e91b04b0962cabf67/users/43ff7a877c874c95a69a09f1ebc3871b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:34.007211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:34.007656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:34.008105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:34.123863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] MFA Rules not processed for user `43ff7a877c874c95a69a09f1ebc3871b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:34.130497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:34.167001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 814/1642] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:34.168016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:34.190839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d2843-ddf8-49d3-a08a-1ee969e8dc4b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:34.304169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:34.304932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:34.305315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:34.305690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:34.375857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:34.389783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 829/1643] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:42:34.432397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:34.437208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:34.458963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 815/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:34.710609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:34.727612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66fe61-0d14-4d74-833a-16f00123df9c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:34.738606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:34.739350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:34.739707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:34.740079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:34.855305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:34.868214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93498-c589-47ff-94b0-294bfa8c0e1a service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:34.886690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:34.893387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:34.894390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:34.894884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:34.895572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:34.915537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:34.916771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfacc28-bf46-4f18-9068-5d9efa095bcb service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:34.920038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:34.921600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:34.940731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 816/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:34.956458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 830/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:35.620419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:35.851585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2b584-8455-43c2-a4a7-cfc54336e4e7 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:35.869866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:35.872289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:35.872620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:35.874468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] PATH_INFO: `/v3/users/2a0139649f62413dadf9a658f438e4a9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:35.879166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0139649f62413dadf9a658f438e4a9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:35.880236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:35.880236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: warnings.warn(msg) Sep 08 18:42:35.880236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: Sep 08 18:42:35.881519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:36.102408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0139649f62413dadf9a658f438e4a9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:36.103961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0139649f62413dadf9a658f438e4a9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:36.134885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0139649f62413dadf9a658f438e4a9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:36.183578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0139649f62413dadf9a658f438e4a9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:36.184364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc40ee30-1883-4814-8421-3cc4dd2d89f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0139649f62413dadf9a658f438e4a9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:36.213994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 817/1647] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:35 2022] DELETE /identity/v3/users/2a0139649f62413dadf9a658f438e4a9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:36.218637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.219532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.220103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.239733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae7db3-794d-4ccd-9233-80f379e95cff None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.240183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae7db3-794d-4ccd-9233-80f379e95cff None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.240498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae7db3-794d-4ccd-9233-80f379e95cff None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.242549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 818/1648] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 8 18:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:36.271664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:36.275261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ade1c-a260-4691-a427-298e48a17110 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.275554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ade1c-a260-4691-a427-298e48a17110 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.275838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ade1c-a260-4691-a427-298e48a17110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.276647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:36.325434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-474ade1c-a260-4691-a427-298e48a17110 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:36.330240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-474ade1c-a260-4691-a427-298e48a17110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:36.413630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 831/1649] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:36.421412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:36.428909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:36.430542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:36.484682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 819/1650] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 8 18:42:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:42:36.491761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47105a-01c1-4c79-8fb3-298cf0abea38 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.492336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47105a-01c1-4c79-8fb3-298cf0abea38 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.492773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47105a-01c1-4c79-8fb3-298cf0abea38 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.496767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 820/1651] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 8 18:42:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:36.500729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.501154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.501532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.537557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:36.541710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:36.551535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9880-27b6-484e-9f3c-aa91bc2cfd0d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:36.558559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:36.559500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.560535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.561005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.565583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 821/1652] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:42:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:36.584644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:36.586531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:36.589069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:36.590573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:36.610704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 832/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:36.728261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb887-41b3-4829-bf04-64a11cdaad0f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:36.743132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:36.745041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:36.745343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:36.746826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:36.775727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:36.777237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:36.807263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 822/1654] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:42:37.048947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:37.070058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9365d-7dca-43f7-bef0-784aeb7e1a55 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:37.075189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:37.075957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:37.076333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:37.076742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:37.079986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:37.164097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:37.166723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:37.195542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 833/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:37.692076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:37.694346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:37.719095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447cf0-1dc3-4413-a7f3-82f3fa3c3f0a service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:37.736399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:37.737889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:37.738538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:37.738955 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] PATH_INFO: `/v3/projects/0c1b9bb88f76424ab4c66c37ae40eb3f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:37.740368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1b9bb88f76424ab4c66c37ae40eb3f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:37.743050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:37.858043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1b9bb88f76424ab4c66c37ae40eb3f', 'request_id': 'req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:37.884027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1b9bb88f76424ab4c66c37ae40eb3f', 'request_id': 'req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:37.899728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1b9bb88f76424ab4c66c37ae40eb3f', 'request_id': 'req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:37.926721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] The token cache is being invalidate because project 0c1b9bb88f76424ab4c66c37ae40eb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:37.927323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:37.928912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:37.931566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 823/1656] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:37 2022] DELETE /identity/v3/projects/0c1b9bb88f76424ab4c66c37ae40eb3f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:37.935501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:37.953750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507be2f8-ef33-4810-93c1-75daf0e09a19 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:38.026791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:38.076920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:38.077677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:38.078026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:38.078317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] PATH_INFO: `/v3/users/43ff7a877c874c95a69a09f1ebc3871b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:38.079809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ff7a877c874c95a69a09f1ebc3871b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:38.081967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:38.207126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ff7a877c874c95a69a09f1ebc3871b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:38.207932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ff7a877c874c95a69a09f1ebc3871b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:38.218195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ff7a877c874c95a69a09f1ebc3871b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:38.232616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ff7a877c874c95a69a09f1ebc3871b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:38.233579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dc84898-6c90-4d39-a6a0-2967e1bb287f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ff7a877c874c95a69a09f1ebc3871b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:38.255981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 834/1657] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:37 2022] DELETE /identity/v3/users/43ff7a877c874c95a69a09f1ebc3871b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:38.787012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:38.789090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:38.823392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e8ef-c19b-4f6a-966e-a75c6a3e7ee4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:38.949857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:38.991050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:38.991924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:38.992293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:38.992641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] PATH_INFO: `/v3/users/1821bb1fc7124392bcfb6417119a42cd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:38.994427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1821bb1fc7124392bcfb6417119a42cd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:38.996830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:39.113717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1821bb1fc7124392bcfb6417119a42cd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:39.115157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1821bb1fc7124392bcfb6417119a42cd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:39.144103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1821bb1fc7124392bcfb6417119a42cd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:39.245676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1821bb1fc7124392bcfb6417119a42cd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:39.247422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1821bb1fc7124392bcfb6417119a42cd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:39.282069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 824/1658] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:38 2022] DELETE /identity/v3/users/1821bb1fc7124392bcfb6417119a42cd => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:39.283243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:39.283697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:39.283812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:39.315000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:39.316606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:39.556642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 835/1659] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:39.569511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:39.570983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:39.768605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162dd03-265b-4202-90b8-d0c3bdfda95c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:39.776466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:39.798544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:39.799558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:39.799984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:39.822924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:39.824937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a7744-8f45-41a8-a3df-5e9d0104c234 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:39.846333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 825/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:40.640826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:40.642638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:40.692549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681909e-4e7c-498a-8068-17cf5bfaf4f4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:40.715278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:40.717448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:40.718391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:40.719545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] PATH_INFO: `/v3/projects/170d20c473ab4f8e91b04b0962cabf67` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:40.723703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170d20c473ab4f8e91b04b0962cabf67)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:40.728741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 18:42:40.728741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 08 18:42:40.728741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: Sep 08 18:42:40.734538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:40.867284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:40.911186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170d20c473ab4f8e91b04b0962cabf67', 'request_id': 'req-dab7bc30-f474-4568-84ad-00fc795d16e4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:40.936013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170d20c473ab4f8e91b04b0962cabf67', 'request_id': 'req-dab7bc30-f474-4568-84ad-00fc795d16e4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:40.963130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170d20c473ab4f8e91b04b0962cabf67', 'request_id': 'req-dab7bc30-f474-4568-84ad-00fc795d16e4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:40.982410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] The token cache is being invalidate because project 170d20c473ab4f8e91b04b0962cabf67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:40.982790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:40.983702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dab7bc30-f474-4568-84ad-00fc795d16e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:40.989734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 836/1661] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:40 2022] DELETE /identity/v3/projects/170d20c473ab4f8e91b04b0962cabf67 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:40.991209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:40.991725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:40.991810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.045714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:41.051225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:41.204077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 826/1662] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:41.213740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.214052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.214531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.262325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:41.265647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:41.297523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 837/1663] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:41.298494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.318633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38280-e79c-41e8-8da3-837bbf187e21 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.342111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.342758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.343314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.343602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.344447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:41.344895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.346733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.363026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:41.403339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 827/1664] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:42:41.410125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.432127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef978-bcfa-4cce-8854-19fdf4c2659e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.446706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.451027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.451440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.451726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.452409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.458393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.564022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.565121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 838/1665] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:41 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:41.582016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2914-3ffb-4529-92c2-e0087db19fd0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.587634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.590700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:41.733666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.734506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.735027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.735501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.736788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.740500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.786880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 828/1666] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:41 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:42:41.793069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.793979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba5ab8-67e4-467e-b5af-db5a1d27b4b8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.804229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.804976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.805165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.805455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] PATH_INFO: `/v3/projects/500d3cd7860b44609694609ad5f39bef` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.806609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500d3cd7860b44609694609ad5f39bef)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.808564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.809218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485c56a-1fad-4b32-9506-37de83e2587d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.817241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.818091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.818474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.818975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.819716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.821465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.855428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 829/1667] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:41.860132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.889539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330387a2-a5a2-4006-abcb-2ef04ddcaa22 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:41.908218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:41.909164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:41.909267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:41.909539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:41.910610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:41.911899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:41.933562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500d3cd7860b44609694609ad5f39bef', 'request_id': 'req-a8c675a7-936a-4a16-912b-684a5cd0b245'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:41.948643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500d3cd7860b44609694609ad5f39bef', 'request_id': 'req-a8c675a7-936a-4a16-912b-684a5cd0b245'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:41.968131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500d3cd7860b44609694609ad5f39bef', 'request_id': 'req-a8c675a7-936a-4a16-912b-684a5cd0b245'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:41.968221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 830/1668] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:41.968963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:41.998340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] The token cache is being invalidate because project 500d3cd7860b44609694609ad5f39bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:41.998722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:41.999381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a8c675a7-936a-4a16-912b-684a5cd0b245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:42.016681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a2bc-9c68-45c2-93c7-25adc4489adb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:42.024263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 839/1669] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:41 2022] DELETE /identity/v3/projects/500d3cd7860b44609694609ad5f39bef => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:42:42.025907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653d98-0904-45ba-8d97-20432f8b1885 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.026233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653d98-0904-45ba-8d97-20432f8b1885 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.026546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653d98-0904-45ba-8d97-20432f8b1885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.075541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4f653d98-0904-45ba-8d97-20432f8b1885 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:42.076645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4f653d98-0904-45ba-8d97-20432f8b1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:42.162407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:42.163233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.163521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.163799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] PATH_INFO: `/v3/projects/a21197f8529047f7ab6b169323e52523/users/020844d79c714fe1991b68032a0c10b5/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.173896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:42.200635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21197f8529047f7ab6b169323e52523, user_id=020844d79c714fe1991b68032a0c10b5, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:42.205575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ef1c-d8c1-404e-bafc-9a36300b0856 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:42.235284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 831/1670] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:41 2022] PUT /identity/v3/projects/a21197f8529047f7ab6b169323e52523/users/020844d79c714fe1991b68032a0c10b5/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:42.247370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.247561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.248047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.248282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 840/1671] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:42.256893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.257514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.258289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.290062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] MFA Rules not processed for user `020844d79c714fe1991b68032a0c10b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:42.291867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:42.315517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:42.316884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:42.366008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:42.440651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 832/1672] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:42.442646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.451287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:42.460123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 841/1673] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:42.464003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.487348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47d9dd-4b88-4c78-b97c-33dff07d4293 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:42.489163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daccaa2-cddf-4bc7-9ae3-24c36d816d98 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:42.495045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:42.495792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.496049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.496324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.497741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:42.508015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:42.519040 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:42.519962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.520346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.520724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.521796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:42.524528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:42.526359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:42.559566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 842/1674] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:42:42.564417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.585060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec38ca-d506-4158-acf4-41633fae2e4c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:42.590574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 833/1675] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:42.593067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.761445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:42.762498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.764014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.764479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.767234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:42.772177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:42.850944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b916-77d7-4a58-805f-189cfab98160 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:42.856026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 843/1676] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/projects => generated 373 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:42.858099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.864869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:42.871855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:42.872492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:42.872772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:42.873043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:42.873682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:42.897247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:42.942712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 834/1677] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:42.943664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:42.961337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afcda-a8f9-4a35-8ba3-e2d6662fb5ea admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.014028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:43.044935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246fea8-a431-4706-89d9-e7aab1a85570 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.050553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.051429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.051861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.052284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] PATH_INFO: `/v3/users/7eef856911e747b6830bbbc1c91439c1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.055233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eef856911e747b6830bbbc1c91439c1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.057349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.150695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.151879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.152927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.153733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.155003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.158048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.180400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eef856911e747b6830bbbc1c91439c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:43.181384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eef856911e747b6830bbbc1c91439c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:43.195531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 835/1678] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:42 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:43.198916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.201072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eef856911e747b6830bbbc1c91439c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:43.207582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:43.240303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eef856911e747b6830bbbc1c91439c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:43.241627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eef856911e747b6830bbbc1c91439c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:43.257411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a786-f9cf-4380-ba0f-20ba77478714 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.271130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.275874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 844/1679] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:42 2022] DELETE /identity/v3/users/7eef856911e747b6830bbbc1c91439c1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:43.276738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.278970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.284558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.284558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.285163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.288586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:43.293187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489625-90e3-4a4b-9bad-925ee98fd974 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.338432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 836/1680] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:43.341717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.342064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.342339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.410321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:43.411599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:43.447452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7cd7-21e3-4076-b1ab-5785ed04550c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.451449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 837/1681] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:43.453143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.455729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.456539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.456672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.456927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.457641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.459925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.493830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 845/1682] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:43.494884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.498882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5aea2-40c1-4071-8115-f162d038eefa None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.516189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.518898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.519415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.519976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] PATH_INFO: `/v3/projects/0656580fb1ae44298f9de895995bc29b/users/3041ed023c1942418497830242dccce0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.520280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c455-2f5d-473f-a90d-fd11cb696102 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.531784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.532429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.532694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.532970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.533629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.535288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.547587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0656580fb1ae44298f9de895995bc29b, user_id=3041ed023c1942418497830242dccce0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.554348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 846/1683] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:43.556433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.558619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.563829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:43.578302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fce90-2b2f-4dc0-9179-095fa9d45118 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.590580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 838/1684] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:43 2022] PUT /identity/v3/projects/0656580fb1ae44298f9de895995bc29b/users/3041ed023c1942418497830242dccce0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:43.592777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.596312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:43.695641 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:43.723482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.723662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.724100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.724534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] PATH_INFO: `/v3/projects/6502a50dda4740ee8dcdfa0f6b4a1e5f/users/2cf2f898597f44bbb6fcac9514e297b6/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.749382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6502a50dda4740ee8dcdfa0f6b4a1e5f, user_id=2cf2f898597f44bbb6fcac9514e297b6, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.753737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.795835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 847/1685] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:43 2022] PUT /identity/v3/projects/6502a50dda4740ee8dcdfa0f6b4a1e5f/users/2cf2f898597f44bbb6fcac9514e297b6/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:43.803485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:43.818188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6a311-4bca-4f9d-8dfc-f53060b96b74 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.909848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b345b7-9703-4ed5-809d-6fe3b039e6d8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:43.915505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.916231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.916658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.916940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.917650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.919927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5137fb9-f03d-44bb-8c6d-a927f4a28456 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.937066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 848/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:43.938582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:43.938713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.939173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.939461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.939783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.940199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.940604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:43.963122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:43.965067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2edd52-1b1b-4197-80b0-470246119e75 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:43.973650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] MFA Rules not processed for user `06577b267fec462c87bfff97abe065de`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:43.975850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:43.988975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 839/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:43.990176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4bfd-43e5-4839-9a78-14be3596c376 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:43.991028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4bfd-43e5-4839-9a78-14be3596c376 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:43.991267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4bfd-43e5-4839-9a78-14be3596c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.059497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b21f4bfd-43e5-4839-9a78-14be3596c376 None None] MFA Rules not processed for user `2cf2f898597f44bbb6fcac9514e297b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:44.061899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b21f4bfd-43e5-4839-9a78-14be3596c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.079369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 849/1688] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:44.090699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:44.118639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad2d2-2a33-48e0-9063-9acc0e0541d3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:44.130820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:44.131679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:44.132077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:44.132451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] PATH_INFO: `/v3/projects/0656580fb1ae44298f9de895995bc29b/users/3041ed023c1942418497830242dccce0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.136127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0656580fb1ae44298f9de895995bc29b, user_id=3041ed023c1942418497830242dccce0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:44.141363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:44.173456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 850/1689] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:44 2022] PUT /identity/v3/projects/0656580fb1ae44298f9de895995bc29b/users/3041ed023c1942418497830242dccce0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:44.174737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:44.185772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.243793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 840/1690] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:44.249908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:44.251044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:44.252097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.333284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] MFA Rules not processed for user `3041ed023c1942418497830242dccce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:44.335834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.339764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:44.400226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f787a-d6c0-438c-8577-c19496c0bae2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:44.415919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:44.416551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:44.416831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:44.417744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.451374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:44.524058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:44.525691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:44.549712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 851/1691] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:44.551882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:44.556492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.560566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 841/1692] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:44.574705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:44.576332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.589878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eb7a7-4d4f-4b53-8fa6-b568317218e8 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:44.610664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:44.611317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:44.611599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:44.611889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.696609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a704-9dca-4449-b866-7770b7ef0219 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:44.707662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:44.708294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:44.708572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:44.708845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:44.728986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:44.732716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:44.759704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:44.762982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:44.764525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 842/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:42:44.775055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 852/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:44.958363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:44.961018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:44.994069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:45.032245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5d5b-6708-4915-9d47-55edc1975914 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:45.047703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:45.048652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.063682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.065495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.072216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:45.175900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e640b9-5119-431a-997e-77da34a66597 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:45.197837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:45.198539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.198827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.199209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] PATH_INFO: `/v3/users/bdc738e190f149a19a2ca496e4981f26` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.200674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc738e190f149a19a2ca496e4981f26)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:45.218101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:45.252087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:45.257142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:45.272067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 853/1695] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:45.273296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:45.291928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41a1a-0160-464d-a716-398b65354aad service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:45.297976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:45.298721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.299227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.299604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] PATH_INFO: `/v3/users/2cf2f898597f44bbb6fcac9514e297b6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.301093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf2f898597f44bbb6fcac9514e297b6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:45.303776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:45.328392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:45.372794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc738e190f149a19a2ca496e4981f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.373579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc738e190f149a19a2ca496e4981f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.391496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc738e190f149a19a2ca496e4981f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.403619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf2f898597f44bbb6fcac9514e297b6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.404537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf2f898597f44bbb6fcac9514e297b6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.415282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:45.417601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc738e190f149a19a2ca496e4981f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.418335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf2f898597f44bbb6fcac9514e297b6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.420734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c903eb36-b45c-45e8-af6e-4b52f649b90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc738e190f149a19a2ca496e4981f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.445243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 843/1696] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:44 2022] DELETE /identity/v3/users/bdc738e190f149a19a2ca496e4981f26 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:45.449655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.450167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.450994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.451858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf2f898597f44bbb6fcac9514e297b6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.453610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08591d8f-86ad-40c1-86c6-bb9cd171ed9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf2f898597f44bbb6fcac9514e297b6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:45.487335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 854/1697] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:45 2022] DELETE /identity/v3/users/2cf2f898597f44bbb6fcac9514e297b6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:45.493105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.493905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.494513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.504821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:45.506218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:45.546956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:45.548194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:45.716069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 844/1698] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:45.718042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 855/1699] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:45.743007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:45.745175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:45.745292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:45.747283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:45.882981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df517-6d76-41ed-abf0-0ae21ed0573e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:45.887987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbed5c-d814-4f59-8118-377f18b191e5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:45.889225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:45.890247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.890739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.892008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.902146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:45.902791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:45.903204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:45.903484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:45.917821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:45.920347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb8b8-0fb2-4a9c-8fe5-ce996498265e service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:45.925805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:45.927407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:45.945543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 845/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:45.950112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 856/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:46.328133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:46.328427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:46.328726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:46.398831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] MFA Rules not processed for user `f4800b1e92614f72981cbf6bb4279aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:46.400147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:46.417825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:46.419315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:46.451964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa179-34b4-4ad1-becf-d8141c90e5f5 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:46.478790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:46.479467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:46.479752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:46.480033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] PATH_INFO: `/v3/projects/1cc6d3d2113c41c19e584273e8782b29` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:46.481301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc6d3d2113c41c19e584273e8782b29)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:46.485771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:46.607734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:46.643277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 846/1702] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:46.651873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc6d3d2113c41c19e584273e8782b29', 'request_id': 'req-ca443ab5-c542-495b-b46d-d67daf8b6226'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:46.663572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:46.665037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:46.668438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc6d3d2113c41c19e584273e8782b29', 'request_id': 'req-ca443ab5-c542-495b-b46d-d67daf8b6226'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:46.680565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc6d3d2113c41c19e584273e8782b29', 'request_id': 'req-ca443ab5-c542-495b-b46d-d67daf8b6226'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:46.717808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] The token cache is being invalidate because project 1cc6d3d2113c41c19e584273e8782b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:46.718155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:46.728425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:46.734621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 857/1703] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:46 2022] DELETE /identity/v3/projects/1cc6d3d2113c41c19e584273e8782b29 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:42:46.737112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:46.743054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:46.746847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:46.898048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bcfd8-9891-452f-8fdb-4fe7570ade5a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:46.939012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443ab5-c542-495b-b46d-d67daf8b6226 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:46.960016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:46.960973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:46.960973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:46.961215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] PATH_INFO: `/v3/users/66a23762204d48738dde31f38f9a81b1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:46.967270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a23762204d48738dde31f38f9a81b1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:46.969155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:47.198437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:47.199090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:47.199379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:47.199660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:47.202114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a23762204d48738dde31f38f9a81b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:47.206702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a23762204d48738dde31f38f9a81b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:47.218927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:47.243610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a23762204d48738dde31f38f9a81b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:47.314276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a23762204d48738dde31f38f9a81b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:47.316681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115544e8-2062-4dde-82ef-3cd2605e1b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a23762204d48738dde31f38f9a81b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:47.364491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 858/1704] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:46 2022] DELETE /identity/v3/users/66a23762204d48738dde31f38f9a81b1 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:47.461716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:47.463414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2e1b3-539e-4b1c-be0a-f762dc6c1536 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:47.483344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 847/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:42:48.773597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:48.774159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:48.774409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:48.831842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] MFA Rules not processed for user `3b06d6cf9b694708a25c0c974558c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:48.833239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:48.886976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:49.034005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 859/1706] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:49.040678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:49.043492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:49.043924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:49.079521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] MFA Rules not processed for user `3b06d6cf9b694708a25c0c974558c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:49.081081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:49.105002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 848/1707] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:49.117768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:49.119387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:49.328936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744c4e-a271-4c45-8da9-cfe5725c764f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:49.350790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025081-b74b-4791-b452-a025689a595b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:49.351646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025081-b74b-4791-b452-a025689a595b service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:49.352401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025081-b74b-4791-b452-a025689a595b service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:49.352797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025081-b74b-4791-b452-a025689a595b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:49.375072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025081-b74b-4791-b452-a025689a595b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:49.376940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025081-b74b-4791-b452-a025689a595b service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:49.396277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:49.398239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:49.403132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 860/1708] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:49.563997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:49.603659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1054f-a44f-47eb-bd82-4ced4f59fd55 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:49.613559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:49.614428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:49.614859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:49.615378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] PATH_INFO: `/v3/projects/6502a50dda4740ee8dcdfa0f6b4a1e5f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:49.618645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6502a50dda4740ee8dcdfa0f6b4a1e5f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:49.621297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:49.756597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6502a50dda4740ee8dcdfa0f6b4a1e5f', 'request_id': 'req-ff6689a7-5611-4956-bc69-84c9e28e8847'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:49.781478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6502a50dda4740ee8dcdfa0f6b4a1e5f', 'request_id': 'req-ff6689a7-5611-4956-bc69-84c9e28e8847'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:49.790245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6502a50dda4740ee8dcdfa0f6b4a1e5f', 'request_id': 'req-ff6689a7-5611-4956-bc69-84c9e28e8847'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:49.839304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] The token cache is being invalidate because project 6502a50dda4740ee8dcdfa0f6b4a1e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:49.839628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:49.840305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff6689a7-5611-4956-bc69-84c9e28e8847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:49.841891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 849/1709] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:49 2022] DELETE /identity/v3/projects/6502a50dda4740ee8dcdfa0f6b4a1e5f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:49.846824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:49.847345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:49.847434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:49.892567 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:49.893794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:50.067479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 861/1710] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:50.075563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.076400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.076847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.122211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:50.130661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:50.171475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 850/1711] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:50.176734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.196405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170071-4b1a-4134-a223-6d3eda416281 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.209985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:50.210833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.211278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.211699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.212532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:50.213176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:50.215119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:50.278427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.283253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 862/1712] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:50.291931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c1dc-2eea-47c0-812a-4db0534aee30 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.305609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:50.306533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.307040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.307502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.308300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:50.310416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26135ed5-1ee7-48d3-b5b8-e1aef78acff8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:50.369420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.370428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 851/1713] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:50 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:50.384766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab0c3-59eb-4969-a78f-cf34d5261879 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.385262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab0c3-59eb-4969-a78f-cf34d5261879 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.385675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab0c3-59eb-4969-a78f-cf34d5261879 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.390723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 852/1714] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 8 18:42:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:50.391449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca26d4-2f7e-4d73-9143-70082354a13d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.398923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.399138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.399421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.481921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:50.492934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:50.494415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:50.550832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:50.551478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.551787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.552065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.552717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:50.558266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:50.655845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 863/1715] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:50 2022] POST /identity/v3/users => generated 286 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:42:50.667195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.676970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:50.711299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2928-d255-40aa-a8fc-144a0d4ad920 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.728035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:50.728965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.729391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.729832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] PATH_INFO: `/v3/projects/044f61601f9e4f5b99bcb463ff5dec78` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.732822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044f61601f9e4f5b99bcb463ff5dec78)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:50.734176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 853/1716] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:42:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:50.735193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:50.739953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.771301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411040f9-442a-4545-9633-0dd05fa83c12 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.787386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:50.788308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:50.788973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:50.790061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:50.792407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:50.794694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:50.835253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 854/1717] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:50.836230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:50.850328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:50.892379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a40d-b03b-462f-84e7-3064dd438195 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:50.898945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044f61601f9e4f5b99bcb463ff5dec78', 'request_id': 'req-c3e61021-efdd-4891-a487-1af01e0131b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:50.925277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044f61601f9e4f5b99bcb463ff5dec78', 'request_id': 'req-c3e61021-efdd-4891-a487-1af01e0131b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:50.939541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044f61601f9e4f5b99bcb463ff5dec78', 'request_id': 'req-c3e61021-efdd-4891-a487-1af01e0131b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:50.989767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] The token cache is being invalidate because project 044f61601f9e4f5b99bcb463ff5dec78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:50.990090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:50.995009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:50.998450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.000350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 864/1718] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:50 2022] DELETE /identity/v3/projects/044f61601f9e4f5b99bcb463ff5dec78 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:51.010520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:51.015376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.053519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:51.054247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.054571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.054814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] PATH_INFO: `/v3/projects/faeca9bf05db441db38597f5b66eaa3e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.056079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeca9bf05db441db38597f5b66eaa3e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:51.058275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:51.143088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e61021-efdd-4891-a487-1af01e0131b0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:51.171131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeca9bf05db441db38597f5b66eaa3e', 'request_id': 'req-fc25591a-a960-4a5c-b508-0d8a38a48974'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.196058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeca9bf05db441db38597f5b66eaa3e', 'request_id': 'req-fc25591a-a960-4a5c-b508-0d8a38a48974'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.215010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeca9bf05db441db38597f5b66eaa3e', 'request_id': 'req-fc25591a-a960-4a5c-b508-0d8a38a48974'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.290555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] The token cache is being invalidate because project faeca9bf05db441db38597f5b66eaa3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:51.290874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.294139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.310423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 855/1719] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:50 2022] DELETE /identity/v3/projects/faeca9bf05db441db38597f5b66eaa3e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:51.313308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:51.321807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.332222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:51.334289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.334729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.336291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.343735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.374358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:51.382199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:51.430207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 865/1720] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:51.434348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:51.440258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.479984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:51.512879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25591a-a960-4a5c-b508-0d8a38a48974 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:51.518770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:51.519649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.520083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.520539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.521335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:51.523675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8d13b-55e6-463d-adad-ff6bc7b1981b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:51.549367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 856/1721] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:51.552591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.553123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.554176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.598688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:51.601833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.635650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 857/1722] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:51.635650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:51.635947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb576-2859-4a45-8c7f-83d6b1dfac18 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:51.651928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af123acc-6842-44f5-8ecc-054eb01c5627 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:51.656112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:51.657577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.658048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.658461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] PATH_INFO: `/v3/users/6468591cc7d24a28bfaf0a3197c365be` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.660493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:51.661443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6468591cc7d24a28bfaf0a3197c365be)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:51.662186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.663405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.663840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] PATH_INFO: `/v3/projects/e1ee2fd90a284a718b61fbb7b79e0cd9/users/9a3927832c90401d81017d5b9b7b293f/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.664930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:51.704516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ee2fd90a284a718b61fbb7b79e0cd9, user_id=9a3927832c90401d81017d5b9b7b293f, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:51.708664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03145899-9332-40bd-87ac-34b0e01e6a17 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:51.748260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 858/1723] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:51 2022] PUT /identity/v3/projects/e1ee2fd90a284a718b61fbb7b79e0cd9/users/9a3927832c90401d81017d5b9b7b293f/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:51.759495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883c72-4b55-4e37-8851-78028080de9b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.760572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883c72-4b55-4e37-8851-78028080de9b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.762275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883c72-4b55-4e37-8851-78028080de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.782591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6468591cc7d24a28bfaf0a3197c365be'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.785673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6468591cc7d24a28bfaf0a3197c365be'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.809367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-19883c72-4b55-4e37-8851-78028080de9b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:51.810879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-19883c72-4b55-4e37-8851-78028080de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.812984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6468591cc7d24a28bfaf0a3197c365be'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.849528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6468591cc7d24a28bfaf0a3197c365be'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.851386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c330d75-20af-4784-a2a7-620769414fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6468591cc7d24a28bfaf0a3197c365be'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:51.875254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:51.881891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 866/1724] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:51 2022] DELETE /identity/v3/users/6468591cc7d24a28bfaf0a3197c365be => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:51.883855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.886487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.887240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:51.944299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 859/1725] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:51.955978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] MFA Rules not processed for user `9a3927832c90401d81017d5b9b7b293f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:51.957788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:51.962341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:51.962930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:51.963381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.051366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] MFA Rules not processed for user `c2ade7e02b814dfab184622fbe3c3557`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:52.069074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:52.190172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 867/1726] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:52.191328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.247027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:52.288564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 860/1727] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:52.290581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.295360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:52.364569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c64c7-af38-4873-8525-ae1cff2249f6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.376361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.377132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.377530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.377960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.378832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:52.379207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:52.381702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83fd5a-3da6-4a3a-adec-fe95ed59403e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:52.427248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 868/1728] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:52.429236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.429531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.429808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.470609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] MFA Rules not processed for user `c2ade7e02b814dfab184622fbe3c3557`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:52.473787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:52.482863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f113-df0b-4b1f-85be-d83ece6a606c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.500241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.500889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.501254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.502082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 869/1729] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:52.504173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.504968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:52.507676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.515872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:52.533112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9808-08c3-4079-9cc8-87f9f043c152 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.539360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.539994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.540273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.540547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.541217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:52.543409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:52.608509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 861/1730] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:52 2022] POST /identity/v3/projects => generated 373 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:52.610382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.613314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:52.625518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 870/1731] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:52 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:52.626485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.690490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:52.723556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b782-2e8b-4a10-9092-c62c11c4a452 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.826117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f349-525f-43a5-9ae2-0b339cfb6054 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.846780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.847428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.847715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.847996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.848652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:52.851328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:52.919586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 871/1732] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:52 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:52.920554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:52.945381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e807-afc8-4f12-a50c-75a2ce6c0b3d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:52.955191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.956152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.957232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.957232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.973653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:52.974318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:52.974758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:52.975730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:52.976619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:52.979926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c9b6-26f9-4348-8cfe-a75c8b33f773 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.055888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 872/1733] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:52 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:53.061636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.065616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.066048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.146565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] MFA Rules not processed for user `06577b267fec462c87bfff97abe065de`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:53.154093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:53.205406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.207829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.240512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 862/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:53.242898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:53.291244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfe99f-c836-4631-af56-8f589a981860 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:53.312400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:53.313746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.314364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.316182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.319221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.331056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.372724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 863/1735] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:53.374284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:53.384952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:53.436450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 873/1736] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:53.444965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:53.452601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb1ae-667c-47c6-9a70-38357b01bc1d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:53.457187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:53.463125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:53.463527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.465960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.466682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] PATH_INFO: `/v3/projects/aae819a94b254958b8bbb85ba91b7b13` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.470451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae819a94b254958b8bbb85ba91b7b13)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.475074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.477198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76953ee6-2fb6-4096-8982-621e7e8591dd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:53.492620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:53.493174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.493462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.493740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.494428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.496050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.547796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 874/1737] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:53.548735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:53.554071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:53.663801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae819a94b254958b8bbb85ba91b7b13', 'request_id': 'req-c33601e2-f7b3-43ea-878b-6eb106b52598'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:53.682117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae819a94b254958b8bbb85ba91b7b13', 'request_id': 'req-c33601e2-f7b3-43ea-878b-6eb106b52598'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:53.692519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae819a94b254958b8bbb85ba91b7b13', 'request_id': 'req-c33601e2-f7b3-43ea-878b-6eb106b52598'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:53.711965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:53.744211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] The token cache is being invalidate because project aae819a94b254958b8bbb85ba91b7b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:53.744648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:53.746075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:53.750404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c237d26-4016-4b03-bef2-52d572bc55a1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:53.755109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 864/1738] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:53 2022] DELETE /identity/v3/projects/aae819a94b254958b8bbb85ba91b7b13 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:53.757366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:53.758875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:53.908920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33601e2-f7b3-43ea-878b-6eb106b52598 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:53.925664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:53.926593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.927018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.927424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] PATH_INFO: `/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c/users/785919af491c4c398d4cdca630b6f795/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.941108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:53.942073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:53.942495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:53.942910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:53.948820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:53.971960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c27d9763fe4e8fa66cd427fd0ab69c, user_id=785919af491c4c398d4cdca630b6f795, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.972147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:53.974765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38782ca7-ef3d-48d8-95e5-65ee429e100d service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:53.975352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:54.010151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 865/1739] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:53 2022] PUT /identity/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c/users/785919af491c4c398d4cdca630b6f795/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:54.011202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.012978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 875/1740] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:54.015033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.019014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a163851-97f2-4b62-a5d3-ae79e8121662 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.019305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a163851-97f2-4b62-a5d3-ae79e8121662 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.019588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a163851-97f2-4b62-a5d3-ae79e8121662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.090658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0a163851-97f2-4b62-a5d3-ae79e8121662 None None] MFA Rules not processed for user `f4800b1e92614f72981cbf6bb4279aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:54.093888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0a163851-97f2-4b62-a5d3-ae79e8121662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.217605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a462-5a80-497b-af83-1f9212274cf2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:54.224038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:54.225365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.225912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.226249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.226912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:54.229633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6640e92-2716-4206-a9fe-d63f1d264dbc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:54.256857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 866/1741] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:54.260953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 876/1742] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:54.263095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.263542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.263919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.265312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.265614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.265896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.303859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:54.308192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.327625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 877/1743] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:54.328940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.330999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] MFA Rules not processed for user `3b06d6cf9b694708a25c0c974558c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:54.332235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.344284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7386-e0eb-496d-9975-a01074ca5b2a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:54.352347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:54.353148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.353579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.353968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.354727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:54.357601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:54.376952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 878/1744] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:54.378787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.392980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa0417-ebed-43a3-94e8-80591df2e0e1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:54.401242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:54.402186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.402565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.402941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] PATH_INFO: `/v3/projects/c6b420a37ff5447eb7f32f26aefbc9ca/users/78b5d3e7e78b4e47b9fb7a3d7f3685df/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.416072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:54.431950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b420a37ff5447eb7f32f26aefbc9ca, user_id=78b5d3e7e78b4e47b9fb7a3d7f3685df, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:54.444072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0960a-e558-463c-9241-499cbc656ae5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:54.478416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 879/1745] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:54 2022] PUT /identity/v3/projects/c6b420a37ff5447eb7f32f26aefbc9ca/users/78b5d3e7e78b4e47b9fb7a3d7f3685df/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:54.487658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef63eb-5505-48c7-bfe1-ed61f6097e68 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.487658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef63eb-5505-48c7-bfe1-ed61f6097e68 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.487658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef63eb-5505-48c7-bfe1-ed61f6097e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.518800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 867/1746] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:54.526503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.538006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-10ef63eb-5505-48c7-bfe1-ed61f6097e68 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:54.539434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-10ef63eb-5505-48c7-bfe1-ed61f6097e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.569175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa63a42-0f20-4067-91ba-e9fe78ef64d7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:54.611386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:54.681496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 880/1747] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:54.683104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ade-cf66-423d-81db-397a03c68dd3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.683450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ade-cf66-423d-81db-397a03c68dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.683828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9ade-cf66-423d-81db-397a03c68dd3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.685920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 881/1748] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 8 18:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:42:54.687808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.688536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.688878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.726793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:54.727497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:54.727856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:54.728204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] PATH_INFO: `/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c/users/785919af491c4c398d4cdca630b6f795/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:54.728575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] MFA Rules not processed for user `78b5d3e7e78b4e47b9fb7a3d7f3685df`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:54.730377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.732004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c27d9763fe4e8fa66cd427fd0ab69c, user_id=785919af491c4c398d4cdca630b6f795, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:54.738414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:54.768562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 868/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:54 2022] PUT /identity/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c/users/785919af491c4c398d4cdca630b6f795/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:54.789900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.797226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:54.951010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 882/1750] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:54.951010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:54.964882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5832d0-76f9-43fc-8bc0-14e1b419d503 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.051559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f27a72-b43d-435a-8288-0338fc1fc8e2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.061543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.062342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.062648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.062941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] PATH_INFO: `/v3/users/020844d79c714fe1991b68032a0c10b5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.067762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020844d79c714fe1991b68032a0c10b5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.067762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.102914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.103936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.104786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.104786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.105356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:42:55.105744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.109857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901abe49-5756-4baa-854d-08aa4887c5ee admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.137895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 883/1751] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:42:55.140897 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.143056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.143422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.177365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:55.179451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.185374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020844d79c714fe1991b68032a0c10b5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:55.186113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020844d79c714fe1991b68032a0c10b5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:55.190160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:55.205776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020844d79c714fe1991b68032a0c10b5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:55.234946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020844d79c714fe1991b68032a0c10b5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:55.235939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-12e588af-dde6-4cc2-bc8f-754aab1c0626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020844d79c714fe1991b68032a0c10b5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:55.286447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 869/1752] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:54 2022] DELETE /identity/v3/users/020844d79c714fe1991b68032a0c10b5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:55.287851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce4cf-0e79-4bee-b25d-59d4f5c1284d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.288150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce4cf-0e79-4bee-b25d-59d4f5c1284d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.288432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce4cf-0e79-4bee-b25d-59d4f5c1284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.340532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 884/1753] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:55.342901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:55.360532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.399908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16126c-03e2-492a-9418-1051f895cbe7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.402370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f4bce4cf-0e79-4bee-b25d-59d4f5c1284d None None] MFA Rules not processed for user `785919af491c4c398d4cdca630b6f795`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:55.404643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f4bce4cf-0e79-4bee-b25d-59d4f5c1284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.461359 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:55.475465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.475465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.475465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.475754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.476413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.480765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.550303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 885/1754] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:55.551390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:55.561130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.596573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 870/1755] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:55.597299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.599755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.600676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.643919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:55.645342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.719264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30c11-a768-4424-a073-0274ff499996 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.725866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.726779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.727137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.727439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.728138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.730701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.777726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 886/1756] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/projects => generated 355 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:55.781092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:55.784444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:55.819397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 871/1757] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:55.824427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:55.847458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9d5-362d-4396-be1b-83d49de23d3e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.867150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:55.919337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05a0d0-cc5c-4c32-b759-2237d8b6e661 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:55.926058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.932898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.933727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.934213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.948781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:55.949406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:55.949690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:55.950153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:55.951265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.953061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.953763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:55.955384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:55.984654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 887/1758] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:55.985913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:55.988395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:56.019635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 872/1759] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:55 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:56.020207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.055560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952a07-0a40-4dba-a4e1-81dae282623c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.071265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.071941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.072166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.072440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.073088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.078831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.113383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62434-1dfc-41f6-b19c-dbc33466cb10 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.126746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.128368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.128587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.129522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.131224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 873/1760] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:56 2022] POST /identity/v3/users => generated 278 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:56.133438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.156662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53de1cf-a224-4d79-a7c4-0f8f64e78deb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.168609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.169041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.169383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.169851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.189248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.191798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.255745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 874/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:56.257212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.295609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de92f8-3c73-41d8-9074-99661757a555 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.313118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.313799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.316318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.316614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.320597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.325468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.341226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.345905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.366359 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 875/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:56.373226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.397905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 888/1763] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:56.398921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.404238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7aa1-a8a5-4be8-bbc7-6603d7aaed34 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.417871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.423618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.424152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.425337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.426422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.428392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.431415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:56.446955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f13325-ed58-47a4-8706-de7bebfa0a24 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.474319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.475334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.475952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.476404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] PATH_INFO: `/v3/projects/4033c1c8d90f4dbd9020e02439545a7a/users/40fe9a73269348debb5a40f6d2255ade/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.491106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 876/1764] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:56.492632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.526140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ee2e-467b-49c9-b1b9-f5d616127d17 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.526625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4033c1c8d90f4dbd9020e02439545a7a, user_id=40fe9a73269348debb5a40f6d2255ade, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.530996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.536919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.538720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.539014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.539317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.540060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.542262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.573062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 877/1765] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:56.577623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.582256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 889/1766] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:56 2022] PUT /identity/v3/projects/4033c1c8d90f4dbd9020e02439545a7a/users/40fe9a73269348debb5a40f6d2255ade/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:56.587797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.629197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdf8c-7ed1-41b1-97cc-bb1cd5013fad admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.663709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea54f-eb7c-4104-93d2-c7bb72c69d34 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.667852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.668895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.669278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.669670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.671727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:56.689266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:56.873448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:56.874653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.874993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.875280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] PATH_INFO: `/v3/projects/aee9b22ffed5451094b7cf34f070ac2a/users/1560e77e3f594cfab3c0b4cdcdf64c00/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:56.893599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.896539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.900023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee9b22ffed5451094b7cf34f070ac2a, user_id=1560e77e3f594cfab3c0b4cdcdf64c00, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:56.906957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001204-b479-4440-bf89-c00062423b3c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:56.919474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 890/1767] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:56.920733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:56.953084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ca52-5580-4e1b-8d18-b8b9c37bc954 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:56.953721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 878/1768] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:56 2022] PUT /identity/v3/projects/aee9b22ffed5451094b7cf34f070ac2a/users/1560e77e3f594cfab3c0b4cdcdf64c00/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:56.965229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:56.965680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:56.965989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.082257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] MFA Rules not processed for user `1560e77e3f594cfab3c0b4cdcdf64c00`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:57.085097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:57.162046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:57.176589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:57.177009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:57.177297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.183755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:57.185764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:57.246389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 891/1769] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:57.247381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:57.301050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48114-6fea-4670-857a-5b595e07d194 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:57.328540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 879/1770] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:42:57.351427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:57.352096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:57.358305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:57.362235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:57.364696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] PATH_INFO: `/v3/projects/4033c1c8d90f4dbd9020e02439545a7a/users/40fe9a73269348debb5a40f6d2255ade/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.367084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:57.384762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4033c1c8d90f4dbd9020e02439545a7a, user_id=40fe9a73269348debb5a40f6d2255ade, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:57.389287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:57.425282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fd59a-8450-49fc-b19d-f2e4e5fcb6c2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:57.446905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:57.448310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:57.448648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:57.448980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] PATH_INFO: `/v3/projects/a21197f8529047f7ab6b169323e52523` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.453159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21197f8529047f7ab6b169323e52523)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:57.455146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:57.473849 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 892/1771] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:57 2022] PUT /identity/v3/projects/4033c1c8d90f4dbd9020e02439545a7a/users/40fe9a73269348debb5a40f6d2255ade/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:57.475780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:57.607162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6d48-333a-4162-af81-891815b67b42 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:57.654932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21197f8529047f7ab6b169323e52523', 'request_id': 'req-bd0d0bc5-7e0d-4895-93b1-851520d4487d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:57.661336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:57.671064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21197f8529047f7ab6b169323e52523', 'request_id': 'req-bd0d0bc5-7e0d-4895-93b1-851520d4487d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:57.682428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21197f8529047f7ab6b169323e52523', 'request_id': 'req-bd0d0bc5-7e0d-4895-93b1-851520d4487d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:57.696212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] The token cache is being invalidate because project a21197f8529047f7ab6b169323e52523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:42:57.697364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:57.698264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd0d0bc5-7e0d-4895-93b1-851520d4487d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:57.700050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 880/1772] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:42:57 2022] DELETE /identity/v3/projects/a21197f8529047f7ab6b169323e52523 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:57.705104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:57.705387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:57.705674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.718680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:57.751894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] MFA Rules not processed for user `40fe9a73269348debb5a40f6d2255ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:57.753372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:57.759725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:57.760539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:57.760923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:57.761326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:57.762421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:57.766781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:57.836488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 893/1773] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:42:57 2022] POST /identity/v3/projects => generated 357 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:57.837689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:57.840036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:57.886642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 881/1774] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:57.888785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:57.894880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:57.938604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fec10-3fba-41d5-9f62-1a237498e172 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:58.074665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95316-b594-4d7f-a74e-2dfee4b270cb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:58.101032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:58.101686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.102028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.102183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:58.102299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:58.104192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.104192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.104461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] PATH_INFO: `/v3/users/3041ed023c1942418497830242dccce0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:58.106140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3041ed023c1942418497830242dccce0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:58.106634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:58.108690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:58.124835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:58.197221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 882/1775] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:42:57 2022] POST /identity/v3/users => generated 285 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:42:58.201107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:58.206620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:58.217573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3041ed023c1942418497830242dccce0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:58.218824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3041ed023c1942418497830242dccce0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:58.244615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3041ed023c1942418497830242dccce0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:58.304631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3041ed023c1942418497830242dccce0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:58.305538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3041ed023c1942418497830242dccce0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:58.336046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 894/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:57 2022] DELETE /identity/v3/users/3041ed023c1942418497830242dccce0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:58.337727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:58.342898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:58.463747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418bdd6-6356-4265-ac4a-535281254d74 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:58.510058 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:58.549723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:58.599455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230eb8e-b6d8-46d9-9573-42adadba8b9a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:58.622097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:58.622777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.623064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.624980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:58.626340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:58.627191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.627367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:58.627680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.628152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:58.630575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:58.635911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84fd3-0694-47af-b89a-004b041435e8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:58.672059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 895/1777] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:58.673527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.673834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.674163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:58.818490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:58.823625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:58.867149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:58.867785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 883/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:42:58.870893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:58.879082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:58.953237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abbfe-ccdb-4f70-a241-7856852a29c8 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:58.976424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:58.982658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:58.984614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:58.985111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] PATH_INFO: `/v3/projects/3254d118d6f449d8a02ff3129321697b/users/bbb8a557ea6843518a17554292cad6fc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.027203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254d118d6f449d8a02ff3129321697b, user_id=bbb8a557ea6843518a17554292cad6fc, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:59.031192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:59.065305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 884/1779] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:58 2022] PUT /identity/v3/projects/3254d118d6f449d8a02ff3129321697b/users/bbb8a557ea6843518a17554292cad6fc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:59.065305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:59.069790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.080923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 896/1780] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:59.082883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:59.112100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8c24-2c53-49be-8659-cfddb82777ef None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:59.221697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24471d3c-64cb-4d7c-a9c8-fe824596b353 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:59.234347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:59.235005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.235286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.235569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] PATH_INFO: `/v3/users/78b5d3e7e78b4e47b9fb7a3d7f3685df` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.237217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b5d3e7e78b4e47b9fb7a3d7f3685df)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:59.239163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:59.248245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:59.248874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.249157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.249429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.250106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:59.251724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:59.275258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 897/1781] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:42:59.283606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:59.301748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abf3b3-4e13-4f71-83c9-845b0b193eef admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:59.311631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:59.312256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.312620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.312944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] PATH_INFO: `/v3/projects/3254d118d6f449d8a02ff3129321697b/users/bbb8a557ea6843518a17554292cad6fc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.330535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254d118d6f449d8a02ff3129321697b, user_id=bbb8a557ea6843518a17554292cad6fc, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:42:59.341791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:59.343551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:42:59.351142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b5d3e7e78b4e47b9fb7a3d7f3685df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:59.352791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b5d3e7e78b4e47b9fb7a3d7f3685df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:59.365091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b5d3e7e78b4e47b9fb7a3d7f3685df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:59.385442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 898/1782] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:42:59 2022] PUT /identity/v3/projects/3254d118d6f449d8a02ff3129321697b/users/bbb8a557ea6843518a17554292cad6fc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:42:59.385442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:59.385913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b5d3e7e78b4e47b9fb7a3d7f3685df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:59.385913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63dce6c9-ef7e-4375-aaf3-9f3296426582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b5d3e7e78b4e47b9fb7a3d7f3685df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:42:59.387513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.417003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 885/1783] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:42:59 2022] DELETE /identity/v3/users/78b5d3e7e78b4e47b9fb7a3d7f3685df => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:42:59.418641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec95a-e213-4695-823c-92fe641981a1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.419637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec95a-e213-4695-823c-92fe641981a1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.420215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ec95a-e213-4695-823c-92fe641981a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.451157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9f9ec95a-e213-4695-823c-92fe641981a1 None None] MFA Rules not processed for user `bbb8a557ea6843518a17554292cad6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:59.452379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9f9ec95a-e213-4695-823c-92fe641981a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.473759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:59.587689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165a54-59a1-4eae-9c12-38a5493de457 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:42:59.611988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 886/1784] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:59.613438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.613896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.614269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.663505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:42:59.664901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.816545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 887/1785] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:42:59.819242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:42:59.821148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.827493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:42:59.831449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:42:59.831747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:42:59.832030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:42:59.844389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:42:59.962573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:42:59.990411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568482f-46cf-402d-83a0-f5f8a89b4b1d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:00.000326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:00.000960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.001243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.001375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:00.003408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:00.006222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:00.024525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 899/1786] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:43:00.026515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:00.028220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:00.074414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:00.075967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:00.144577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 888/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:42:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:00.196677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86795-1b8f-45f6-ad56-eaa2caebe3ed service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:00.206409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:00.210528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.211091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.211595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:00.254573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:00.259367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:00.309747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 900/1788] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:00.352104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:00.367321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd462e-4ffa-4e8a-a82b-c8b86706b9c3 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:00.383150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:00.383764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.384060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.384333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:00.395604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:00.546215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:00.547821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:00.570036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:00.576589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e9c8-f750-41e2-9476-8bb75c9310ff service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:00.582921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7dbf7-b6d4-46fd-b752-77576309900c service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:00.606095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:00.614516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.614516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.614516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] PATH_INFO: `/v3/projects/0656580fb1ae44298f9de895995bc29b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:00.617075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0656580fb1ae44298f9de895995bc29b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:00.623302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:00.625202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:00.643949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 889/1789] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:00.849284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0656580fb1ae44298f9de895995bc29b', 'request_id': 'req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:00.876825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0656580fb1ae44298f9de895995bc29b', 'request_id': 'req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:00.893987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0656580fb1ae44298f9de895995bc29b', 'request_id': 'req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:00.898943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.899368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.900249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:00.943636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] The token cache is being invalidate because project 0656580fb1ae44298f9de895995bc29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:00.945239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:00.946521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80a2e4ed-ca30-4e8d-a4d2-6a182675b1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:00.948722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 901/1790] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:00 2022] DELETE /identity/v3/projects/0656580fb1ae44298f9de895995bc29b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:00.954115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52de3a-13c7-4816-a753-f6091dc97601 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:00.954625 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52de3a-13c7-4816-a753-f6091dc97601 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:00.955286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52de3a-13c7-4816-a753-f6091dc97601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.014952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:01.032862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:01.103892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8e52de3a-13c7-4816-a753-f6091dc97601 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:01.115088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8e52de3a-13c7-4816-a753-f6091dc97601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:01.393797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 890/1791] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 8 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:01.470589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:01.472185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:01.496384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 902/1792] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:01.505094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.505549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.505762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.513457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f70a1-c71e-4a54-8686-408c7a4d3bdd None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:01.530676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:01.534290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.535047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.536593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.570561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:01.574263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:01.575016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:01.588715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:01.601927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 903/1793] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:01.606463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:01.633980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324753-daa3-4a7c-9317-334de1c2c724 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:01.641980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 891/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:01.664542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:01.665724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.666220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.666805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.667655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:01.668113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:01.669877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:01.697818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 904/1795] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:01.704230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:01.728942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca3d4-4a66-4eb7-8d7b-e51c0b0a13c1 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:01.736920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:01.743118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.743421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.743710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.744381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:01.749216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:01.817180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 892/1796] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:01 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:01.817472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:01.828401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f082a1-5984-42bc-b8b7-84a6154cbdb6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:01.950514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:01.953140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:01.959672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:01.971657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52eb92-44bb-417c-9b13-3d2e28e7dcda admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:01.972543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.972906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.973198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.974096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:01.977567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:01.978825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:01.979025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:01.979624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:01.979981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] PATH_INFO: `/v3/projects/c6b420a37ff5447eb7f32f26aefbc9ca` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:01.982904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b420a37ff5447eb7f32f26aefbc9ca)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:01.987381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:02.024378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:02.032517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 905/1797] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:01 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:02.036978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:02.068721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ee1e2-9d02-48c4-9d42-07fa62e8a7b9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:02.106338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b420a37ff5447eb7f32f26aefbc9ca', 'request_id': 'req-f6638679-8f20-40f1-94ea-4762afd140ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.116133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:02.129390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b420a37ff5447eb7f32f26aefbc9ca', 'request_id': 'req-f6638679-8f20-40f1-94ea-4762afd140ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.142378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b420a37ff5447eb7f32f26aefbc9ca', 'request_id': 'req-f6638679-8f20-40f1-94ea-4762afd140ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.186060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] The token cache is being invalidate because project c6b420a37ff5447eb7f32f26aefbc9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:02.186324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.190747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.196929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 893/1798] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:01 2022] DELETE /identity/v3/projects/c6b420a37ff5447eb7f32f26aefbc9ca => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:02.199231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:02.207916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:02.254606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:02.255237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:02.255523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:02.255799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:02.256491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:02.260051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:02.319212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 906/1799] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:02.322286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:02.334032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:02.363123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e75df-ddf8-4c64-b5c1-38d0ce978bfa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:02.377796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:02.378760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:02.379173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:02.379594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:02.380377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:02.384353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:02.392538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6638679-8f20-40f1-94ea-4762afd140ea admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:02.413879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 907/1800] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:02.414979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:02.415773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:02.416437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:02.416884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:02.417178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] PATH_INFO: `/v3/users/40fe9a73269348debb5a40f6d2255ade` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:02.419273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fe9a73269348debb5a40f6d2255ade)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:02.421623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:02.438982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bb55-e5d4-49e1-8ce2-ec46bebdf739 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:02.450670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:02.451553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:02.452077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:02.452461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] PATH_INFO: `/v3/projects/8dfd084dd38646cf85ef1e1e3f8b7b57/users/22024bb66db946888e2a974793b3d781/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:02.488612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfd084dd38646cf85ef1e1e3f8b7b57, user_id=22024bb66db946888e2a974793b3d781, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:02.497785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680a28-bb89-4b3d-b9e1-a952450df13c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:02.543663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 908/1801] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:02 2022] PUT /identity/v3/projects/8dfd084dd38646cf85ef1e1e3f8b7b57/users/22024bb66db946888e2a974793b3d781/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:02.546159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:02.546444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:02.546725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:02.549053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fe9a73269348debb5a40f6d2255ade'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.550705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fe9a73269348debb5a40f6d2255ade'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.580576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fe9a73269348debb5a40f6d2255ade'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.642746 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fe9a73269348debb5a40f6d2255ade'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.650386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fe9a73269348debb5a40f6d2255ade'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:02.664540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] MFA Rules not processed for user `22024bb66db946888e2a974793b3d781`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:02.667992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:02.694438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 894/1802] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:02 2022] DELETE /identity/v3/users/40fe9a73269348debb5a40f6d2255ade => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:02.877842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 909/1803] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:02.882150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:02.884265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:03.131410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a6cd-54f6-4dda-95c6-e8937149acb4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:03.137443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:03.138158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:03.138443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:03.138719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:03.139363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:03.141347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:03.146784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:03.209508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 895/1804] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:02 2022] POST /identity/v3/projects => generated 377 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:03.211940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:03.339929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:03.380932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e84241-0652-4549-82ea-28e57531dc22 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:03.567403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:03.568202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:03.568202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:03.568490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:03.569258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:03.577065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:03.629526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 910/1805] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:03 2022] POST /identity/v3/users => generated 295 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:03.636063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:03.671203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e0545-4140-425f-bb7c-29b7128cf783 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:03.701749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:03.702719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:03.703994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:03.704530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:03.705397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:03.710531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:03.742559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:03.748891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 896/1806] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:03.767736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419791d-7a71-4305-9127-9ecd7922ea4c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:03.793041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:03.797051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:03.797397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:03.797729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] PATH_INFO: `/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf/users/a84134e38ef44ded9547ee7f9133cae2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:03.839678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0a7b5d45db4516bc38708ab01aa1bf, user_id=a84134e38ef44ded9547ee7f9133cae2, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:03.843643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:03.865379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 911/1807] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:03 2022] PUT /identity/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf/users/a84134e38ef44ded9547ee7f9133cae2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:03.872518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:03.886311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213457-3b84-48ac-a656-da5f31293d2b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:04.046158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:04.049403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:04.051807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:04.060246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:04.064985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:04.072449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bedd4-06d5-4e92-8e82-ba51d495154a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:04.113523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 897/1808] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:04.115222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:04.133113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079de4a-95d8-456d-8819-d0bac45cf96e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:04.148214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:04.152077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:04.152393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:04.152685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] PATH_INFO: `/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf/users/a84134e38ef44ded9547ee7f9133cae2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:04.157093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0a7b5d45db4516bc38708ab01aa1bf, user_id=a84134e38ef44ded9547ee7f9133cae2, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:04.163911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:04.202690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 912/1809] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:04 2022] PUT /identity/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf/users/a84134e38ef44ded9547ee7f9133cae2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:04.214159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:04.214920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:04.215368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:04.314377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] MFA Rules not processed for user `a84134e38ef44ded9547ee7f9133cae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:04.315656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:04.569769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 898/1810] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:04.607632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:04.610306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:04.638981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:04.640689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:04.802453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce6a5-5f40-40da-bd0e-eca23b9ad78b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:04.804381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188d9e-df83-4cfc-ba7c-012a00843ba9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:04.822118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:04.823974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:04.824555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:04.825102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] PATH_INFO: `/v3/projects/4033c1c8d90f4dbd9020e02439545a7a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:04.826677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4033c1c8d90f4dbd9020e02439545a7a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:04.829403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:04.832051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:04.832694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:04.833906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:04.834855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:04.863981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:05.010507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4033c1c8d90f4dbd9020e02439545a7a', 'request_id': 'req-fd4c4337-cc46-4bcf-b214-789e7878aff1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:05.022061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:05.033442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4033c1c8d90f4dbd9020e02439545a7a', 'request_id': 'req-fd4c4337-cc46-4bcf-b214-789e7878aff1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:05.043461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:05.044958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7aa8-0230-4a47-8f5a-7572a630224b service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:05.050915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4033c1c8d90f4dbd9020e02439545a7a', 'request_id': 'req-fd4c4337-cc46-4bcf-b214-789e7878aff1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:05.072096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 899/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:05.106844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] The token cache is being invalidate because project 4033c1c8d90f4dbd9020e02439545a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:05.107773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:05.114205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fd4c4337-cc46-4bcf-b214-789e7878aff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:05.125634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 913/1812] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:04 2022] DELETE /identity/v3/projects/4033c1c8d90f4dbd9020e02439545a7a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:05.127007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:05.127299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:05.129408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:05.189869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:05.199803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:05.466957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 900/1813] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:05.475778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:05.476067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:05.476352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:05.535721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:05.536974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:05.564578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 914/1814] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:05.565403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:05.578904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d745c-76cd-421f-bc9c-c9691e243c74 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:05.602152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:05.602857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:05.603224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:05.603406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:05.604215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:05.604529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:05.621566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:05.705464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 901/1815] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:05.708949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:05.738053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9d11-6d10-493d-97b7-51afcb190457 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:05.770941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:05.776837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:05.778590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:05.778897 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:05.782979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:05.793660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:05.908365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 915/1816] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:05 2022] POST /identity/v3/projects => generated 399 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:05.908648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:05.951633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c841-89b0-4bc2-b3ed-e6dcfe4451e6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:06.196581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:06.197374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:06.197600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:06.206818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:06.207589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:06.227833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:06.283224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:06.292792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 902/1817] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:05 2022] POST /identity/v3/users => generated 300 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:06.326235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1645b-7b31-485d-ad7e-a475fba00444 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:06.344616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:06.346416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:06.350099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:06.350613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:06.353520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:06.361063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:06.416642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 916/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:06.417910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:06.448476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cdddc-ea0c-4b0f-81e1-c37dd0acf6df admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:06.469523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:06.470534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:06.471146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:06.472187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:06.480573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:06.490059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6227f-aa76-402a-8bbc-b6923dcfc5c1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:06.546613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 903/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:06.546760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:06.564898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2232-a6da-40fa-af67-2071607c0adc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:06.598979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:06.599455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:06.599833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:06.600213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] PATH_INFO: `/v3/projects/2156391662c842c4a8f5aecd74639301/users/c21ac86259bb4b6f9e1446a39c2a3e5f/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:06.672646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2156391662c842c4a8f5aecd74639301, user_id=c21ac86259bb4b6f9e1446a39c2a3e5f, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:06.681823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:06.724518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 917/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:06 2022] PUT /identity/v3/projects/2156391662c842c4a8f5aecd74639301/users/c21ac86259bb4b6f9e1446a39c2a3e5f/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:06.739951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:06.741724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:06.742165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:06.859731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] MFA Rules not processed for user `c21ac86259bb4b6f9e1446a39c2a3e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:06.861409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:06.883481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:07.185724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 904/1821] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:07.189983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:07.426086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de19f9-fb6c-486e-96bb-2c94aebb1746 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:07.443944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:07.444626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:07.444925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:07.445201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:07.450239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:07.460297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:07.591060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 918/1822] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:07 2022] POST /identity/v3/projects => generated 401 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:07.591609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:07.610531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb555ec-dd77-4c3b-9a51-bb829408ac97 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:07.779976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:07.780772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:07.780954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:07.781231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:07.790849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:07.807941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:07.859152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 905/1823] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:07 2022] POST /identity/v3/users => generated 307 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:07.863615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:07.881991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498bee-868a-4d39-8c32-2396807c3599 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:07.908667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:07.910338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:07.912125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:07.913755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:07.916984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:07.922277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:07.960054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:07.972680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 919/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:07.979039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72fed-6d2b-47f6-bdda-c31f179a8d3a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:08.001352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:08.002061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:08.002378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:08.002657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] PATH_INFO: `/v3/projects/8d86736ff5b74ee59807a1061a4743ac/users/a02585a0cfc840068bdc4a6f46e3704b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:08.063595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d86736ff5b74ee59807a1061a4743ac, user_id=a02585a0cfc840068bdc4a6f46e3704b, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:08.074556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:08.140297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 906/1825] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:07 2022] PUT /identity/v3/projects/8d86736ff5b74ee59807a1061a4743ac/users/a02585a0cfc840068bdc4a6f46e3704b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:08.144364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:08.161648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036c54-4892-4f0e-a1eb-b3128fddcc04 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:08.364972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:08.402628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:08.405113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:08.405775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:08.407530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:08.410062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:08.413965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386fd0f-cbb9-40c4-b7b9-d92c888e2579 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:08.447387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 920/1826] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:08.452872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:08.469149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754a9b-f75d-43b3-8421-a14cd432458c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:08.484612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:08.485374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:08.485616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:08.485967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] PATH_INFO: `/v3/projects/8d86736ff5b74ee59807a1061a4743ac/users/a02585a0cfc840068bdc4a6f46e3704b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:08.490044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d86736ff5b74ee59807a1061a4743ac, user_id=a02585a0cfc840068bdc4a6f46e3704b, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:08.493360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:08.530501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 907/1827] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:08 2022] PUT /identity/v3/projects/8d86736ff5b74ee59807a1061a4743ac/users/a02585a0cfc840068bdc4a6f46e3704b/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:08.545059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:08.545351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:08.545752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:08.613615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] MFA Rules not processed for user `a02585a0cfc840068bdc4a6f46e3704b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:08.614952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:08.899901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 921/1828] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:08.939757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:08.947817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:09.135706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:09.137586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:09.184124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a654b5c-9afb-4f2e-b70b-2463c9bf36be None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:09.191181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b2541-90cc-4430-a944-f70c927b3ba6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:09.220698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:09.223029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.223452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.223768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.227145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:09.228115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.228760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.229033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.230604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:09.271986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:09.276524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4be68-2d05-46df-8eb7-9d372308fd31 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:09.297203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:09.311821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 908/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:09.315052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29367-55c8-4d0e-91d0-fffe7747a64f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.316239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29367-55c8-4d0e-91d0-fffe7747a64f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.316844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29367-55c8-4d0e-91d0-fffe7747a64f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.320871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 909/1830] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:43:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:43:09.327887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.328961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.330104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.387235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:09.391024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:09.412282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:09.413810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:09.444259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 922/1831] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:09.590400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 910/1832] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:09.602424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:09.604176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:09.638935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:09.668815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8f78-daa0-45ac-8241-cecb151d9118 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:09.670046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003067-f36f-4fd4-9f0d-a42720cb1864 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:09.681267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:09.687674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:09.688305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.688589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.689476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.701408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.702513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.703873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.716827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:09.718787 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd669c-3d55-4183-bc66-9e50e52a1da3 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:09.758237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 923/1833] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:09.786847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201bc93-96c4-411d-8848-405e6bbdbef1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:09.787380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201bc93-96c4-411d-8848-405e6bbdbef1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:09.787845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201bc93-96c4-411d-8848-405e6bbdbef1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:09.789906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 924/1834] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:43:09.881928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:09.889213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:09.947990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 911/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:10.145915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:10.154094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:10.154094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:10.204887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:10.209920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:10.241287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 925/1836] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:43:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:11.247635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:11.284691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9d1a-95c7-47d5-bdcc-3ccc8c4a8187 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:11.308883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:11.309521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:11.309833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:11.310108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:11.330635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:11.332355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228388ae-9661-4f00-9e44-093bffbc8400 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:11.376458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 912/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:15.179227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:15.252182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:15.284758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508f2ff-1883-479e-aade-4291957bf9fb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:15.290972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:15.291879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:15.292725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:15.295492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] PATH_INFO: `/v3/users/c21ac86259bb4b6f9e1446a39c2a3e5f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:15.297287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21ac86259bb4b6f9e1446a39c2a3e5f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:15.300012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:15.379325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21ac86259bb4b6f9e1446a39c2a3e5f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:15.380095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21ac86259bb4b6f9e1446a39c2a3e5f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:15.391088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21ac86259bb4b6f9e1446a39c2a3e5f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:15.413773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21ac86259bb4b6f9e1446a39c2a3e5f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:15.414883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21ac86259bb4b6f9e1446a39c2a3e5f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:15.432582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 926/1838] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:15 2022] DELETE /identity/v3/users/c21ac86259bb4b6f9e1446a39c2a3e5f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:15.437160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:15.437723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:15.437723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:15.468451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:15.469824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:15.543916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 913/1839] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:15.553791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:15.555241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:15.658543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3157c-b23c-4e6c-8544-378e33ce39c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:15.663219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:15.664494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:15.664776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:15.665053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:15.675871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:15.677301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:15.687284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 927/1840] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:15.954096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:15.955858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:15.970322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b292-340c-4632-8c1f-0a35154f2ff7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:15.975683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:15.976404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:15.976687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:15.977088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] PATH_INFO: `/v3/projects/2156391662c842c4a8f5aecd74639301` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:15.978268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2156391662c842c4a8f5aecd74639301)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:15.980168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:15.993044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:16.029531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2156391662c842c4a8f5aecd74639301', 'request_id': 'req-b9221bda-855c-46e8-8568-af5ce14d6b2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.037237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2156391662c842c4a8f5aecd74639301', 'request_id': 'req-b9221bda-855c-46e8-8568-af5ce14d6b2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.043845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2156391662c842c4a8f5aecd74639301', 'request_id': 'req-b9221bda-855c-46e8-8568-af5ce14d6b2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.054611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] The token cache is being invalidate because project 2156391662c842c4a8f5aecd74639301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:16.054896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.055518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.056996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 914/1841] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:15 2022] DELETE /identity/v3/projects/2156391662c842c4a8f5aecd74639301 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:16.060942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:16.070420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995de1-814a-43ec-a5e6-29794d78da60 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:16.131763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:16.132540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:16.132829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:16.133105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] PATH_INFO: `/v3/users/a02585a0cfc840068bdc4a6f46e3704b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:16.134284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02585a0cfc840068bdc4a6f46e3704b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:16.138045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:16.149287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:16.195055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02585a0cfc840068bdc4a6f46e3704b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.196065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02585a0cfc840068bdc4a6f46e3704b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.203818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02585a0cfc840068bdc4a6f46e3704b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.220008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02585a0cfc840068bdc4a6f46e3704b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.220838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-69c212dd-4387-49a3-9613-8d93378c0eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02585a0cfc840068bdc4a6f46e3704b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.244023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 928/1842] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:16 2022] DELETE /identity/v3/users/a02585a0cfc840068bdc4a6f46e3704b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:16.615264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:16.617237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:16.632852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9221bda-855c-46e8-8568-af5ce14d6b2b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:16.735791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:16.737236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:16.737529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:16.738460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] PATH_INFO: `/v3/projects/8d86736ff5b74ee59807a1061a4743ac` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:16.740261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d86736ff5b74ee59807a1061a4743ac)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:16.744728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:16.831950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d86736ff5b74ee59807a1061a4743ac', 'request_id': 'req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.843228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d86736ff5b74ee59807a1061a4743ac', 'request_id': 'req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.852060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d86736ff5b74ee59807a1061a4743ac', 'request_id': 'req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.865918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] The token cache is being invalidate because project 8d86736ff5b74ee59807a1061a4743ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:16.866240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.866931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1dbf1dd0-3e33-42bf-996b-bed83e4783e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:16.870035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 915/1843] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:16 2022] DELETE /identity/v3/projects/8d86736ff5b74ee59807a1061a4743ac => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:16.873452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:16.873810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:16.874173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:16.896300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:16.898389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:16.966498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 929/1844] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:16.974271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:16.974566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:16.974882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:16.995378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:16.996596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:17.005637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 916/1845] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:17.010467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.024472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69e7c6-1ab5-46d6-8c5d-0cf3c3ad2f81 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.029723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.030399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.030682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.030958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.031623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:17.031933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.033598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.050082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 930/1846] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:43:17.051629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.065699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785959-9e21-4797-85e2-ba36b9e571f6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.072077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.072709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.072995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.073271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.073925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.076124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.111076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 917/1847] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:17 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:17.116954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.132925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7061cae-4c9e-44c7-b07b-3858642f3e0b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.210166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.210865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.211069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.211350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.212049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.214006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.241152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 931/1848] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:17 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:17.243864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.249548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:17.259233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c918c-027f-4940-a5eb-a462d1460498 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.272514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.273765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.274589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.275379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.275760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.277685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.291394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 918/1849] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:17.295703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.306729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:17.310745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6979f9-baad-4cd8-9a72-8c36d0dda499 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.328763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.329727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.330617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.331036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.331844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.334555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851fe5f-14fd-4521-aa80-e1a6e5f6701a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.354125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 932/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:17.365284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.401734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033d29-71c7-45c2-ada4-c26a89abd14d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.411488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.413515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.413812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.414135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] PATH_INFO: `/v3/projects/35678db5253446859f6c7e798f09c10b/users/8b5c6f934d8f42e987442d16a01313c6/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.437023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=35678db5253446859f6c7e798f09c10b, user_id=8b5c6f934d8f42e987442d16a01313c6, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.440848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.458618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 919/1851] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:17 2022] PUT /identity/v3/projects/35678db5253446859f6c7e798f09c10b/users/8b5c6f934d8f42e987442d16a01313c6/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:17.463989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fd42-2f4f-44d2-9011-72cd5d0375bc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.464282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fd42-2f4f-44d2-9011-72cd5d0375bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.464746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fd42-2f4f-44d2-9011-72cd5d0375bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.491342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70c1fd42-2f4f-44d2-9011-72cd5d0375bc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:17.493010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70c1fd42-2f4f-44d2-9011-72cd5d0375bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:17.578867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 933/1852] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:17.588405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:17.590220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:17.740463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d305a71-dfa4-4449-b019-728a78c110eb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:17.764714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:17.767143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:17.770115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:17.773020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:17.810896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:17.818614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:17.842605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 920/1853] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:18.833576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:18.834054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:18.834054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:18.874063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] MFA Rules not processed for user `8b5c6f934d8f42e987442d16a01313c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:18.876059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:18.977987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 934/1854] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:18.981928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:18.992164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3d7c-2410-463e-ae00-1a171bc8a999 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:18.997085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:18.997815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:18.998336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:18.998687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:18.999412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.001552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.035290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 921/1855] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:18 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:19.042668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:19.050934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345041c-e9cc-456e-9cd7-5c6f62f3416e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:19.118439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:19.119711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.120289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.120458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.121157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.124837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.163923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 935/1856] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:19 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:19.167531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:19.183052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf205-64fc-4ca8-a406-985313adeced admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:19.188357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:19.189566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.190050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.190539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.191907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.195012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.224244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 922/1857] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:19.228716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:19.248366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcfda0-b896-49aa-8f54-ce7200eef727 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:19.260557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:19.261436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.261894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.262920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] PATH_INFO: `/v3/projects/41474f9f795b463399398ac42840aa21/users/9d493f6cad23465d8e850007e1e5f1bc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.297532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:19.311085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=41474f9f795b463399398ac42840aa21, user_id=9d493f6cad23465d8e850007e1e5f1bc, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.319242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.358493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 936/1858] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:19 2022] PUT /identity/v3/projects/41474f9f795b463399398ac42840aa21/users/9d493f6cad23465d8e850007e1e5f1bc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:19.359259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:19.374383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124d5d-5723-4004-976c-68ede7816bc6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:19.541283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:19.542063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.542691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.542808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.551506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.553996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375ab39-f138-4776-a40f-b30e695a7ff2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.574882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:19.596485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 923/1859] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:19.603187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537bd3a-1c00-42d5-acbd-eb5dbe2446ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:19.613008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:19.613908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.621427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.621427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] PATH_INFO: `/v3/projects/41474f9f795b463399398ac42840aa21/users/9d493f6cad23465d8e850007e1e5f1bc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.621427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41474f9f795b463399398ac42840aa21, user_id=9d493f6cad23465d8e850007e1e5f1bc, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:19.621693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c56684-9d55-42a4-8bda-8d315937a55d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:19.637522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 937/1860] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:19 2022] PUT /identity/v3/projects/41474f9f795b463399398ac42840aa21/users/9d493f6cad23465d8e850007e1e5f1bc/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:19.782873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.783241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.783622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.785174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 924/1861] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:43:19.811405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf96b6-13ce-4919-92c8-422e84a196e4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:19.811901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf96b6-13ce-4919-92c8-422e84a196e4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:19.812332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf96b6-13ce-4919-92c8-422e84a196e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:19.841706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d8cf96b6-13ce-4919-92c8-422e84a196e4 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:19.844796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8cf96b6-13ce-4919-92c8-422e84a196e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:19.962657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 938/1862] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:43:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:20.000840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:20.002715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:20.033821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0d5e-1570-4331-b835-23473d10c772 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:20.043206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:20.043999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:20.044290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:20.044571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:20.069774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:20.071908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac65cd-1ab6-4569-bc53-1fa35f6c7e83 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:20.118811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 925/1863] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:20.621725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:20.622045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:20.622326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:20.663586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] MFA Rules not processed for user `9d493f6cad23465d8e850007e1e5f1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:20.665252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:20.805573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 939/1864] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:20.818490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:20.819543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:20.819969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:20.860918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] MFA Rules not processed for user `8b5c6f934d8f42e987442d16a01313c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:20.862708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:20.894233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:20.983265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 926/1865] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:20.989060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:21.010973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296d178-fbc0-4521-8e48-bf1b89556a37 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:21.020185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275238-6294-4175-b013-412576d1054c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:21.020950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275238-6294-4175-b013-412576d1054c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:21.021327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275238-6294-4175-b013-412576d1054c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:21.021871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275238-6294-4175-b013-412576d1054c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:21.037049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275238-6294-4175-b013-412576d1054c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:21.039628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275238-6294-4175-b013-412576d1054c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:21.058509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:21.060883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:21.073621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 940/1866] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:21.162943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a7a27-9e5a-433d-a98c-64c34572ae0a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:21.169123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:21.170169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:21.170535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:21.170922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] PATH_INFO: `/v3/users/1560e77e3f594cfab3c0b4cdcdf64c00` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:21.172523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1560e77e3f594cfab3c0b4cdcdf64c00)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:21.175254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:21.300624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1560e77e3f594cfab3c0b4cdcdf64c00'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:21.301327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1560e77e3f594cfab3c0b4cdcdf64c00'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:21.314736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1560e77e3f594cfab3c0b4cdcdf64c00'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:21.329052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1560e77e3f594cfab3c0b4cdcdf64c00'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:21.329839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1560e77e3f594cfab3c0b4cdcdf64c00'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:21.348137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 927/1867] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:21 2022] DELETE /identity/v3/users/1560e77e3f594cfab3c0b4cdcdf64c00 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:21.353310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:21.353602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:21.354048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:21.379918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:21.381713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:21.424294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:21.480132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 941/1868] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:21.489309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:21.492686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:21.596396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:21.619852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27ffe-cea3-44bd-811b-9eb87e00d0a8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:21.634248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:21.635089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:21.635837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:21.636117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:21.658515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:21.659982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:21.676687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 928/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:22.467325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:22.469496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:22.487948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859f411-4617-41d5-8c86-6a5433997f2d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:22.500958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:22.501630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:22.501914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:22.502255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] PATH_INFO: `/v3/projects/aee9b22ffed5451094b7cf34f070ac2a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:22.503418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee9b22ffed5451094b7cf34f070ac2a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:22.505346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:22.568384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee9b22ffed5451094b7cf34f070ac2a', 'request_id': 'req-a487cd2c-863c-43da-9cf0-2567320f015e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.581784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee9b22ffed5451094b7cf34f070ac2a', 'request_id': 'req-a487cd2c-863c-43da-9cf0-2567320f015e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.595230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee9b22ffed5451094b7cf34f070ac2a', 'request_id': 'req-a487cd2c-863c-43da-9cf0-2567320f015e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.612076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] The token cache is being invalidate because project aee9b22ffed5451094b7cf34f070ac2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:22.612496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.613342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.620408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 942/1870] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:22 2022] DELETE /identity/v3/projects/aee9b22ffed5451094b7cf34f070ac2a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:22.621803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:22.636111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676a0ea-39d9-4ba4-9a8f-be409a9580a4 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:22.759055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:22.759947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:22.760264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:22.760539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] PATH_INFO: `/v3/users/bbb8a557ea6843518a17554292cad6fc` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:22.762166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb8a557ea6843518a17554292cad6fc)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:22.764153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:22.856264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb8a557ea6843518a17554292cad6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.857106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb8a557ea6843518a17554292cad6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.869059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb8a557ea6843518a17554292cad6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.901536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb8a557ea6843518a17554292cad6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.904386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-69b52583-e391-4979-ae88-6a80a2e7a1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb8a557ea6843518a17554292cad6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:22.939455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 929/1871] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:22 2022] DELETE /identity/v3/users/bbb8a557ea6843518a17554292cad6fc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:23.620966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:23.623209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:23.648532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cd2c-863c-43da-9cf0-2567320f015e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:23.744461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:23.746319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:23.746972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:23.747467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] PATH_INFO: `/v3/projects/3254d118d6f449d8a02ff3129321697b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:23.748842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3254d118d6f449d8a02ff3129321697b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:23.752663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:23.825013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3254d118d6f449d8a02ff3129321697b', 'request_id': 'req-07aa96fc-21a5-46f1-8558-674952e8ca9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:23.835976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3254d118d6f449d8a02ff3129321697b', 'request_id': 'req-07aa96fc-21a5-46f1-8558-674952e8ca9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:23.845869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3254d118d6f449d8a02ff3129321697b', 'request_id': 'req-07aa96fc-21a5-46f1-8558-674952e8ca9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:23.851195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:23.859783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] The token cache is being invalidate because project 3254d118d6f449d8a02ff3129321697b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:23.860399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:23.861364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-07aa96fc-21a5-46f1-8558-674952e8ca9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:23.863278 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 943/1872] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:23 2022] DELETE /identity/v3/projects/3254d118d6f449d8a02ff3129321697b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:23.868232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:23.869139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:23.869418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:23.891817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:23.893214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:23.966423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 930/1873] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:23.974029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:23.974519 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:23.975506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:23.996468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:23.997931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:24.007128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 944/1874] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:24.012496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.024202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388de49-ac58-4041-8a72-857dd8df44ab None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.028917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.029657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.030113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.030396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.031085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:24.031368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.033118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.034756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:24.049152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 931/1875] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:24.054582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.070653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47126d-4a4f-4750-a61b-187a14f973b4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.076179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.077358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.077898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.078893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.079764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.082194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.122996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 945/1876] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:24 2022] POST /identity/v3/projects => generated 407 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:24.126896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.142648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743cfc9-20f1-4122-8d9a-53623fab7289 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.231919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.232631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.233173 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.233544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.234372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.236576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.288833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 932/1877] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:24 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:24.288932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.304595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb7d8-c73f-4336-91bd-5046a5dad77a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.314852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.315481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.315843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.316045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.316712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.321618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.338017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 946/1878] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:24.339136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.354479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e38b8-bac9-4e5b-b1b0-013d2a4d96c4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.360332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.361366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.361983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.362285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.363523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.365596 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83b845-44da-4d0f-80b2-4bc6a09d64dc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.379776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 933/1879] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:24.390239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.421099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d4a53-7657-4371-884a-f8685dbce26c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.434138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.434820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.435287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.435403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] PATH_INFO: `/v3/projects/32e957daeac549849388f548c4aac001/users/2da8e44033b44089a04ebb5aa22ef8ea/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.454531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e957daeac549849388f548c4aac001, user_id=2da8e44033b44089a04ebb5aa22ef8ea, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.457238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.485595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 947/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:24 2022] PUT /identity/v3/projects/32e957daeac549849388f548c4aac001/users/2da8e44033b44089a04ebb5aa22ef8ea/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:24.488234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.488479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.488754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.531736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] MFA Rules not processed for user `2da8e44033b44089a04ebb5aa22ef8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:24.532858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:24.633083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 934/1881] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:24 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:24.637828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.720544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82da7-0d0b-4ca5-a90b-8bf6ef96d0fe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.726045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.726793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.727305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.727672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.728424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.731145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.764733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 948/1882] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:24 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:24.769988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.781013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b385f3-3bb9-4276-baa3-e05999d296de None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.852190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.852925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.853277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.853624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.854343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.856506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.872762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:24.888562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 935/1883] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:24 2022] POST /identity/v3/users => generated 310 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:24.889855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.901837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e744af-c1a5-42a6-98f5-beba3e142eba admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.907956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.908834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.909336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.909649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.910566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.912815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:24.924452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 949/1884] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:24.929490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:24.940440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230fe7-c5dd-458b-adc7-76cca350d124 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:24.946702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:24.947504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:24.948537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:24.948537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] PATH_INFO: `/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e/users/e6d454825a5947af9a4e6d99b6f618e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:24.977447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d911180c0e9f4390a3c3a51c2d84c55e, user_id=e6d454825a5947af9a4e6d99b6f618e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:24.994258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:25.007464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 936/1885] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:24 2022] PUT /identity/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e/users/e6d454825a5947af9a4e6d99b6f618e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:25.011585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.024931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc2024-f6f3-4819-af24-439dea829bb4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.096492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:25.097107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.097459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.097735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.098418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:25.100550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b5057-a93a-4a7b-969c-cd6268181d95 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:25.107367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:25.116621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 950/1886] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:25.117737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.129818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a900f-893d-458d-b316-5224071b9282 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.134542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:25.135202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.135604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.135883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] PATH_INFO: `/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e/users/e6d454825a5947af9a4e6d99b6f618e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.137774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d911180c0e9f4390a3c3a51c2d84c55e, user_id=e6d454825a5947af9a4e6d99b6f618e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:25.140544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:25.152360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 937/1887] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:25 2022] PUT /identity/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e/users/e6d454825a5947af9a4e6d99b6f618e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:25.165544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526af04-eb07-4189-9535-32843d14c494 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.165837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526af04-eb07-4189-9535-32843d14c494 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.166292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526af04-eb07-4189-9535-32843d14c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.199375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a526af04-eb07-4189-9535-32843d14c494 None None] MFA Rules not processed for user `e6d454825a5947af9a4e6d99b6f618e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:25.200665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a526af04-eb07-4189-9535-32843d14c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.248481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.250741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.312171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 951/1888] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:25.324822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526af04-eb07-4189-9535-32843d14c494 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.327620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a526af04-eb07-4189-9535-32843d14c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.344547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c6a7-b019-4f2c-8996-84bf6319322f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.351740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:25.353028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.353911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.354388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] PATH_INFO: `/v3/users/22024bb66db946888e2a974793b3d781` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.356362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22024bb66db946888e2a974793b3d781)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:25.358505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:25.421768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526af04-eb07-4189-9535-32843d14c494 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.425886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:25.426701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.427180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.427550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.434066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22024bb66db946888e2a974793b3d781'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:25.435205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22024bb66db946888e2a974793b3d781'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:25.439339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:25.441141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491664d-94b2-4198-b5ae-09b65b109db6 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:25.456048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 952/1889] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:25.460497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22024bb66db946888e2a974793b3d781'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:25.506873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22024bb66db946888e2a974793b3d781'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:25.513975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22024bb66db946888e2a974793b3d781'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:25.541334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 938/1890] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:25 2022] DELETE /identity/v3/users/22024bb66db946888e2a974793b3d781 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:25.545116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.546704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.547215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.596420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:25.602033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.778086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 953/1891] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:25.827648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.829225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.851277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:25.852690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.926858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:25.940425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:25.977377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a59ef-2459-4b77-b92a-9b67d8db2e74 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.981339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:25.982228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:25.982580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:25.982924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:25.983864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f411f-7e97-41f2-9c62-65b8046c962f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:25.984993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:25.995778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:26.001523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:26.002380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:26.003198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:26.032836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:26.040895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:26.071691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:26.073449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:26.076587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 939/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:26.087979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 954/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:27.268657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:27.278293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:27.309795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713e99-f38a-4567-864f-1431c09023ed service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:27.316805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:27.320315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:27.321142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:27.321657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] PATH_INFO: `/v3/projects/8dfd084dd38646cf85ef1e1e3f8b7b57` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:27.323559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfd084dd38646cf85ef1e1e3f8b7b57)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:27.326187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:27.405645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfd084dd38646cf85ef1e1e3f8b7b57', 'request_id': 'req-254820ec-26a6-44fc-989b-104b3279bf43'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.421950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfd084dd38646cf85ef1e1e3f8b7b57', 'request_id': 'req-254820ec-26a6-44fc-989b-104b3279bf43'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.432204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfd084dd38646cf85ef1e1e3f8b7b57', 'request_id': 'req-254820ec-26a6-44fc-989b-104b3279bf43'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.456724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] The token cache is being invalidate because project 8dfd084dd38646cf85ef1e1e3f8b7b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:27.457069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.458350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.461860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 940/1894] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:27 2022] DELETE /identity/v3/projects/8dfd084dd38646cf85ef1e1e3f8b7b57 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:27.465904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:27.482468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cbb69-24a2-4d3c-930a-5ffe0c8b32bf service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:27.581916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:27.583162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:27.583785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:27.583785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] PATH_INFO: `/v3/users/a84134e38ef44ded9547ee7f9133cae2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:27.585837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84134e38ef44ded9547ee7f9133cae2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:27.588632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:27.703452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84134e38ef44ded9547ee7f9133cae2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.705607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84134e38ef44ded9547ee7f9133cae2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.728093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84134e38ef44ded9547ee7f9133cae2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.759680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84134e38ef44ded9547ee7f9133cae2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.761674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3680dd62-cc8c-43c2-bd12-a95e929672a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84134e38ef44ded9547ee7f9133cae2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:27.800734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 955/1895] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:27 2022] DELETE /identity/v3/users/a84134e38ef44ded9547ee7f9133cae2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:28.615832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:28.617447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:28.632255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254820ec-26a6-44fc-989b-104b3279bf43 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:28.716948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:28.717967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:28.718468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:28.718983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] PATH_INFO: `/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:28.720869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0a7b5d45db4516bc38708ab01aa1bf)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:28.723312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:28.775482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0a7b5d45db4516bc38708ab01aa1bf', 'request_id': 'req-528dba43-ce63-4928-a2e5-50e70580c4d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:28.782261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0a7b5d45db4516bc38708ab01aa1bf', 'request_id': 'req-528dba43-ce63-4928-a2e5-50e70580c4d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:28.788863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0a7b5d45db4516bc38708ab01aa1bf', 'request_id': 'req-528dba43-ce63-4928-a2e5-50e70580c4d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:28.790122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:28.806445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] The token cache is being invalidate because project 3e0a7b5d45db4516bc38708ab01aa1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:28.807341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:28.808371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-528dba43-ce63-4928-a2e5-50e70580c4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:28.813891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 941/1896] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:28 2022] DELETE /identity/v3/projects/3e0a7b5d45db4516bc38708ab01aa1bf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:28.816802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:28.817312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:28.817606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:28.849856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:28.882324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:28.883818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:28.976433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 956/1897] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:28.984082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:28.984715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:28.985166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.009410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:29.010706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:29.019830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 942/1898] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:29.024985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.038657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49277-658d-4b6b-bd5a-dd8e28bfc43f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.043760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.044376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.044656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.044926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.045573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:29.045877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.047640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.063430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 957/1899] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:29.077528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.089811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7996a-8222-4f50-bce6-dd93bdd08847 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.098353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.099283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.100719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.101195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.102318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.104850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.166780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 943/1900] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:29 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:29.170669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.184663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272dedc-610e-4294-ad76-cb042c480b5a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.262929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.263771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.264057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.264337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.265361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.279248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.311746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 958/1901] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:29 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:29.316417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.334019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed1cc-9379-4256-9dba-cf93e80d3f3b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.360064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.362036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.364280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.364773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.367957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.369880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.397289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 944/1902] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:29.401426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.423894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adc14-e5aa-483c-866d-b88245794a1a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.431346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.432079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.432845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.434128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.434705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.436379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0c29e-0a6a-4a73-9f1f-c4a978e12d49 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.449991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 959/1903] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:29.453697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.464471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e68c-e7b8-4c6e-9399-758cf596f9e4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.470343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.471265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.471557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.471950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] PATH_INFO: `/v3/projects/219c12037e11494fb75c00a102f88091/users/6a83e231d59a4882b0472adaaa9d463c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.490289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219c12037e11494fb75c00a102f88091, user_id=6a83e231d59a4882b0472adaaa9d463c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.493678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.511695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 945/1904] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:29 2022] PUT /identity/v3/projects/219c12037e11494fb75c00a102f88091/users/6a83e231d59a4882b0472adaaa9d463c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:29.533249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.533473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.533747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.576224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] MFA Rules not processed for user `6a83e231d59a4882b0472adaaa9d463c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:29.577446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:29.658726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:29.668132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 960/1905] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:29.673572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.765902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a780e-2ec7-4978-af2a-946b6fc07fa8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.770831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.771545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.772436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.772800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.773775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.775815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.806357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 946/1906] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:29 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:29.810634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.822370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b513-9fe4-460b-874b-f4da6c646e78 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.885565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.886226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.886528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.886810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.887523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.889499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.919681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 961/1907] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:29 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:29.921076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.932248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da970-efa5-4701-ac5a-06812e453df7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.937110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.937932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.938273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.938548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.939193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.940876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:29.952568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 947/1908] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:29.957540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:29.971516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c02087-85cd-4984-b033-cd9873d3d388 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:29.977237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:29.977916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:29.978269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:29.978526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] PATH_INFO: `/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c/users/0c1b014d35d24cfe8d90337334822dc3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:29.994335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9bbd8be80f41f88918decbf74a3f3c, user_id=0c1b014d35d24cfe8d90337334822dc3, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:29.996977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:30.011270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 962/1909] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:29 2022] PUT /identity/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c/users/0c1b014d35d24cfe8d90337334822dc3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:30.015487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:30.026298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cd0e-7d68-4077-8762-d5a72161d470 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:30.083475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:30.084087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:30.084883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:30.085159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:30.085798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:30.087513 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2563b-7d67-4258-a9f3-e0ccc4ed1066 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:30.088928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:30.101988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 948/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:30.104161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:30.114279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe6b4-adf7-469a-b217-7c768b326231 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:30.118958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:30.119613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:30.119893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:30.120171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] PATH_INFO: `/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c/users/0c1b014d35d24cfe8d90337334822dc3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:30.122144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9bbd8be80f41f88918decbf74a3f3c, user_id=0c1b014d35d24cfe8d90337334822dc3, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:30.124733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:30.136577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 963/1911] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:30 2022] PUT /identity/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c/users/0c1b014d35d24cfe8d90337334822dc3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:30.147724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:30.148663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:30.148955 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:30.178659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] MFA Rules not processed for user `0c1b014d35d24cfe8d90337334822dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:30.180019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:30.289766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 949/1912] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:30.297048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:30.298805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:30.384636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006ef04-8954-428d-aa4f-bfa82777447f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:30.390305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:30.391006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:30.391360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:30.391741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:30.409228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:30.411218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:30.427472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 964/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:31.046685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:31.058660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9eb6e-3e52-412f-b633-012ad0620ea8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:31.064402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1b014d35d24cfe8d90337334822dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b9bbd8be80f41f88918decbf74a3f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:31.064996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.065297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.065584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.066553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:31.067028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:31.069053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:31.084555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 950/1914] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:31.089022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:31.101663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bd314-bf11-4e79-ad20-d11eacb8c294 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:31.106958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1b014d35d24cfe8d90337334822dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b9bbd8be80f41f88918decbf74a3f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:31.107649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.108025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.108391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.109111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:31.111155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:31.153046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 965/1915] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:31 2022] POST /identity/v3/projects => generated 351 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:31.155326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:31.175522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45727c-55b7-4316-8b46-6d5004915878 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:31.237477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1b014d35d24cfe8d90337334822dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b9bbd8be80f41f88918decbf74a3f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:31.238544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.238817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.239381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.241353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:31.241763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:31.243725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:31.260342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 951/1916] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:31.312440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:31.326909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534a9b9-58d2-4f48-a5c6-12068bbccb85 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:31.333517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c1b014d35d24cfe8d90337334822dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b9bbd8be80f41f88918decbf74a3f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:31.334735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.335108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.336348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] PATH_INFO: `/v3/projects/8a0cdb3c9fdd4a78aa0d2c82cf075b58` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.338523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a0cdb3c9fdd4a78aa0d2c82cf075b58)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:31.340776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:31.394175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:31.417846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0cdb3c9fdd4a78aa0d2c82cf075b58', 'request_id': 'req-780ee79e-8434-4845-8188-25728fd0763c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.427072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0cdb3c9fdd4a78aa0d2c82cf075b58', 'request_id': 'req-780ee79e-8434-4845-8188-25728fd0763c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.437087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0cdb3c9fdd4a78aa0d2c82cf075b58', 'request_id': 'req-780ee79e-8434-4845-8188-25728fd0763c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.453362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] The token cache is being invalidate because project 8a0cdb3c9fdd4a78aa0d2c82cf075b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:31.453924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.455226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-780ee79e-8434-4845-8188-25728fd0763c tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.458224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 966/1917] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:31 2022] DELETE /identity/v3/projects/8a0cdb3c9fdd4a78aa0d2c82cf075b58 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:31.662735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:31.665372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:31.738811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106c81e-6e15-4f67-8222-ab6390aff392 tempest-VolumeQuotaClassesTest-850282806 tempest-VolumeQuotaClassesTest-850282806-project-admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:31.743197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:31.805424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:31.806220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.806502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.806776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] PATH_INFO: `/v3/users/6a83e231d59a4882b0472adaaa9d463c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.808510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a83e231d59a4882b0472adaaa9d463c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:31.810782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:31.887505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a83e231d59a4882b0472adaaa9d463c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.888178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a83e231d59a4882b0472adaaa9d463c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.895485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a83e231d59a4882b0472adaaa9d463c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.911851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a83e231d59a4882b0472adaaa9d463c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.912577 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a83e231d59a4882b0472adaaa9d463c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:31.925969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 952/1918] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:31 2022] DELETE /identity/v3/users/6a83e231d59a4882b0472adaaa9d463c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:31.930436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:31.930726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:31.931027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:31.950352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:31.951779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.018013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 967/1919] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:32.029706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.032941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.121927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd9503-22b0-4f9a-ad42-a4a47fb3d95b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:32.129075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:32.129715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:32.130662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:32.131172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:32.144012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:32.145863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a907-af1a-4e82-829c-d21e546a78ab service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:32.159149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 953/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:32.239171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.241604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.260573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303fb1d-4250-4a07-bbc4-a34ff360aa36 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:32.267191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:32.268205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:32.268643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:32.269120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] PATH_INFO: `/v3/users/2da8e44033b44089a04ebb5aa22ef8ea` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:32.270501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da8e44033b44089a04ebb5aa22ef8ea)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:32.273987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:32.330769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da8e44033b44089a04ebb5aa22ef8ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.331424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da8e44033b44089a04ebb5aa22ef8ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.338852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da8e44033b44089a04ebb5aa22ef8ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.374460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da8e44033b44089a04ebb5aa22ef8ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.375411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da8e44033b44089a04ebb5aa22ef8ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.399980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 968/1921] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:32 2022] DELETE /identity/v3/users/2da8e44033b44089a04ebb5aa22ef8ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:32.403883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:32.405395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:32.405784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:32.457981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:32.460331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.504828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:32.556338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 954/1922] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:32.570372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.572619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.611992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.614718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:32.625565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:32.633017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc197d-5be4-4daa-9e69-f2a31fc0ae88 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:32.640929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:32.641789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:32.642401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:32.642686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] PATH_INFO: `/v3/projects/219c12037e11494fb75c00a102f88091` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:32.644070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219c12037e11494fb75c00a102f88091)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:32.658810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:32.710966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce95c1-6f9e-4466-b3b2-0c78ec8bdf93 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:32.728327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:32.729138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:32.729602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:32.729867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:32.748925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:32.750430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:32.765045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 969/1923] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:32.804243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219c12037e11494fb75c00a102f88091', 'request_id': 'req-46ec3d4d-71f9-482e-ac19-ee156c01f592'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.814535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219c12037e11494fb75c00a102f88091', 'request_id': 'req-46ec3d4d-71f9-482e-ac19-ee156c01f592'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.829490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219c12037e11494fb75c00a102f88091', 'request_id': 'req-46ec3d4d-71f9-482e-ac19-ee156c01f592'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.846521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] The token cache is being invalidate because project 219c12037e11494fb75c00a102f88091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:32.846521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.847074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:32.850791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 955/1924] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:32 2022] DELETE /identity/v3/projects/219c12037e11494fb75c00a102f88091 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:32.854888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.865272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e02ca-81f3-4f4e-8681-5a7af78d7577 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:32.965760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:32.967461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.002359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:33.003200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:33.003523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:33.003873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] PATH_INFO: `/v3/users/0c1b014d35d24cfe8d90337334822dc3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:33.005189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1b014d35d24cfe8d90337334822dc3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:33.010556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:33.080520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec3d4d-71f9-482e-ac19-ee156c01f592 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:33.090456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:33.091510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:33.091907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:33.092190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] PATH_INFO: `/v3/users/9a3927832c90401d81017d5b9b7b293f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:33.093396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3927832c90401d81017d5b9b7b293f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:33.094065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1b014d35d24cfe8d90337334822dc3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.095552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:33.096084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1b014d35d24cfe8d90337334822dc3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.113762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1b014d35d24cfe8d90337334822dc3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.146156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1b014d35d24cfe8d90337334822dc3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.147530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-637e5d40-4289-47be-96b0-fffac868b4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1b014d35d24cfe8d90337334822dc3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.173420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3927832c90401d81017d5b9b7b293f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.175546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 970/1925] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:32 2022] DELETE /identity/v3/users/0c1b014d35d24cfe8d90337334822dc3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:33.176125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3927832c90401d81017d5b9b7b293f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.187072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3927832c90401d81017d5b9b7b293f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.189087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:33.208042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3927832c90401d81017d5b9b7b293f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.209323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3927832c90401d81017d5b9b7b293f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.258081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 956/1926] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:32 2022] DELETE /identity/v3/users/9a3927832c90401d81017d5b9b7b293f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:33.262502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:33.262985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:33.263095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:33.330198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:33.331447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.444928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:33.485165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 971/1927] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:33.539390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:33.540916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.543177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:33.544661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.557863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b37a-d763-477f-958a-e0c4077b56e7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:33.567169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:33.573089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:33.573376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:33.573653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] PATH_INFO: `/v3/projects/32e957daeac549849388f548c4aac001` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:33.575472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e957daeac549849388f548c4aac001)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:33.577403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:33.675578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b694d7-7bf3-4cb7-bd96-f03248b76845 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:33.678882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e957daeac549849388f548c4aac001', 'request_id': 'req-453a4ab8-5213-46cf-ae00-afe3351e5933'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.696979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e957daeac549849388f548c4aac001', 'request_id': 'req-453a4ab8-5213-46cf-ae00-afe3351e5933'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.705667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e957daeac549849388f548c4aac001', 'request_id': 'req-453a4ab8-5213-46cf-ae00-afe3351e5933'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.731837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] The token cache is being invalidate because project 32e957daeac549849388f548c4aac001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:33.732174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.732921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:33.735024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 957/1928] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:33 2022] DELETE /identity/v3/projects/32e957daeac549849388f548c4aac001 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:33.741258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:33.753436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.816875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:33.819715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:33.820508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:33.820781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:33.827464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.979246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:33.980728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:33.992022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4ab8-5213-46cf-ae00-afe3351e5933 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:33.995481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 972/1929] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:33.996331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:33.998016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:33.998851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:33.999768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.000070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.000350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] PATH_INFO: `/v3/users/e6d454825a5947af9a4e6d99b6f618e1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.002598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d454825a5947af9a4e6d99b6f618e1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.004972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.012407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5fb9d-f675-411d-95fe-4d182f32cc85 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.027923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.028589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.028873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.029208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] PATH_INFO: `/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.030818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9bbd8be80f41f88918decbf74a3f3c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.033312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.081603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d454825a5947af9a4e6d99b6f618e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.082743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d454825a5947af9a4e6d99b6f618e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.092794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d454825a5947af9a4e6d99b6f618e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.095969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:34.106464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9bbd8be80f41f88918decbf74a3f3c', 'request_id': 'req-0bf21b03-8f55-4eb2-8433-f2049db277e3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.108646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:34.116437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d454825a5947af9a4e6d99b6f618e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.116998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9bbd8be80f41f88918decbf74a3f3c', 'request_id': 'req-0bf21b03-8f55-4eb2-8433-f2049db277e3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.117878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f66e21e-15fb-43cf-8ffc-a806e26846f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d454825a5947af9a4e6d99b6f618e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.128894 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9bbd8be80f41f88918decbf74a3f3c', 'request_id': 'req-0bf21b03-8f55-4eb2-8433-f2049db277e3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.139333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 958/1930] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:33 2022] DELETE /identity/v3/users/e6d454825a5947af9a4e6d99b6f618e1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:34.149439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] The token cache is being invalidate because project 4b9bbd8be80f41f88918decbf74a3f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:34.150167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.150999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bf21b03-8f55-4eb2-8433-f2049db277e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.157314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 973/1931] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:33 2022] DELETE /identity/v3/projects/4b9bbd8be80f41f88918decbf74a3f3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:34.159148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.159589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.160018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.181524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:34.182996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.295154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 959/1932] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:34.298183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.299067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.299576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.331049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:34.332527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.343814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 974/1933] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:34.350926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.366908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c5ae-598f-4260-bdc5-749ce722d96e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.374125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.375054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.375376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.375794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.376727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:34.377283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.379494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.400776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 960/1934] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:43:34.402051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.424539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229305c-3947-40f4-ad43-0ee8c4da8062 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.430889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.432644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.432993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.433428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.434422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.437015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.474130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.478409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.501687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 975/1935] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:34.505974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.520789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699789-c21c-48e8-8d59-ceb2f669e22e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.624429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b08-fd87-4eb5-be2c-bc48e53ebe0f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.630461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.642145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.642276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.642470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.642810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.643269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.643430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.643689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.644016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] PATH_INFO: `/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.645310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d911180c0e9f4390a3c3a51c2d84c55e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.648357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.665719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.699160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 976/1936] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:34.702837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.715174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd911180c0e9f4390a3c3a51c2d84c55e', 'request_id': 'req-8f1d48f7-7cbf-4229-ba69-844655cb31d4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.715559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dded17-ba57-4e8b-91fb-8712b1e779dd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.726673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd911180c0e9f4390a3c3a51c2d84c55e', 'request_id': 'req-8f1d48f7-7cbf-4229-ba69-844655cb31d4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.737354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd911180c0e9f4390a3c3a51c2d84c55e', 'request_id': 'req-8f1d48f7-7cbf-4229-ba69-844655cb31d4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.761728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:34.777007 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] The token cache is being invalidate because project d911180c0e9f4390a3c3a51c2d84c55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:34.777337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.778861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8f1d48f7-7cbf-4229-ba69-844655cb31d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.781042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 961/1937] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:34 2022] DELETE /identity/v3/projects/d911180c0e9f4390a3c3a51c2d84c55e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:34.792314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.792846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.793417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.813177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.814076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.814833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.815268 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.816773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:34.816938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.818035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.820059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26a6fc-ccc2-4a52-8663-1c820b4d258e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.827609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 962/1938] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:34.830095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.831666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.845561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08ae13-92f0-4d35-8d13-55d57342ee83 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.846184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 977/1939] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:34.847803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.848126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.848804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.853372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.854083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.854360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.854693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] PATH_INFO: `/v3/projects/e1ee2fd90a284a718b61fbb7b79e0cd9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.855840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ee2fd90a284a718b61fbb7b79e0cd9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.857807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.875934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:34.878699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.895192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 978/1940] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:34.899399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.899399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:34.912356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb81130-9d5b-47f9-80f3-758adf0dcbc5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.919438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:34.920219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:34.920633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:34.922804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:34.922804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:34.923610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:34.935290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 979/1941] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:34.936163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.943036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ee2fd90a284a718b61fbb7b79e0cd9', 'request_id': 'req-f63163bd-7888-49c2-a379-aa2e7b5be180'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.947596 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12212-0f47-4ac1-abe7-490bd3748128 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:34.954074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ee2fd90a284a718b61fbb7b79e0cd9', 'request_id': 'req-f63163bd-7888-49c2-a379-aa2e7b5be180'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.963219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ee2fd90a284a718b61fbb7b79e0cd9', 'request_id': 'req-f63163bd-7888-49c2-a379-aa2e7b5be180'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.967058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:34.983877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] The token cache is being invalidate because project e1ee2fd90a284a718b61fbb7b79e0cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:34.984476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.985413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:34.988441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 963/1942] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:34 2022] DELETE /identity/v3/projects/e1ee2fd90a284a718b61fbb7b79e0cd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:34.991996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:34.991996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.048042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.048669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.048952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.049227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.049935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:35.050270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.051941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.066963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 980/1943] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:35.067970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.078526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.084733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63163bd-7888-49c2-a379-aa2e7b5be180 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.089463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.090159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.090450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.090777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] PATH_INFO: `/v3/projects/dd09a3b093ff4a67bca7466879352776/users/1870b968c7b8436c9c4c297f6bd5694a/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.091281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bf956-015e-46fe-9f45-96ae49dfc82d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.096128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.096758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.097040 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.097317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] PATH_INFO: `/v3/users/785919af491c4c398d4cdca630b6f795` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.098521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785919af491c4c398d4cdca630b6f795)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.100497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.106131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd09a3b093ff4a67bca7466879352776, user_id=1870b968c7b8436c9c4c297f6bd5694a, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.108803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.122438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 964/1944] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:34 2022] PUT /identity/v3/projects/dd09a3b093ff4a67bca7466879352776/users/1870b968c7b8436c9c4c297f6bd5694a/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:35.123225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.139072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.153379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785919af491c4c398d4cdca630b6f795'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.154095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785919af491c4c398d4cdca630b6f795'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.161785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785919af491c4c398d4cdca630b6f795'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.174913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785919af491c4c398d4cdca630b6f795'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.175829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b1bc3bcb-c1ea-450d-96a9-e9e296eb92d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785919af491c4c398d4cdca630b6f795'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.190637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 981/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:35 2022] DELETE /identity/v3/users/785919af491c4c398d4cdca630b6f795 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:35.195459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.195848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.196024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.200092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:35.215771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7e73-9812-4f55-bf2e-4969e6c8a181 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.227977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] MFA Rules not processed for user `1870b968c7b8436c9c4c297f6bd5694a`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:35.229321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.295095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.295978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.296336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.296726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.297441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.300412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.345575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 965/1946] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:35.349748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.352284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.404056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 982/1947] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:35.416419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.417825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.438995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:35.480220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1674a-b456-4d70-ba7d-d115f454413b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.502719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.503684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.504819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.506331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.507105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.517500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.530817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbcf28-ef8f-4f7d-a670-32a1813f5a0c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.562977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 966/1948] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:35.566756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.590787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c770f2-8d2f-471b-aa5e-ccd1c5064fd4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.602874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.605903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.606201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.606483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.607430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.611185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.631230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 967/1949] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:35.641030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.642102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.642827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.643179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.643518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.663050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7bcbf-7db4-4914-9f45-a487e899a63b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.669762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.670392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.670725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.671010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.671658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.673253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.688860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 968/1950] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:35.690245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.704732 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbcd57-0a52-4fc4-8688-a2d36930b176 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.713583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.714678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.715158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.715620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] PATH_INFO: `/v3/projects/553f192310b94f679d8cf5c6f78850e7/users/b3bb49dcaab9412594681b893c1618f5/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.737137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553f192310b94f679d8cf5c6f78850e7, user_id=b3bb49dcaab9412594681b893c1618f5, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.740424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164e20-9d73-4750-a894-8132c3b479f2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.746785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.748410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.759000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 983/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:35.759846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.761261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.774523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 969/1952] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:35 2022] PUT /identity/v3/projects/553f192310b94f679d8cf5c6f78850e7/users/b3bb49dcaab9412594681b893c1618f5/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:35.785633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.785916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.786331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.790646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5d6b7-3fdc-4099-a2e0-fe389f45ad7b service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.820250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] MFA Rules not processed for user `b3bb49dcaab9412594681b893c1618f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:35.821545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:35.841066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:35.865088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.865691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.866005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.866287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] PATH_INFO: `/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.867916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c27d9763fe4e8fa66cd427fd0ab69c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.869403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.909247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 970/1953] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:35.910685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:35.914048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:35.923979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ac36-4ab8-47a3-ad2f-e6f517af352c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:35.936111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c27d9763fe4e8fa66cd427fd0ab69c', 'request_id': 'req-0a31401d-7111-4d29-981e-e1785a02e583'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.945427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c27d9763fe4e8fa66cd427fd0ab69c', 'request_id': 'req-0a31401d-7111-4d29-981e-e1785a02e583'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.953100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c27d9763fe4e8fa66cd427fd0ab69c', 'request_id': 'req-0a31401d-7111-4d29-981e-e1785a02e583'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.966663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] The token cache is being invalidate because project 74c27d9763fe4e8fa66cd427fd0ab69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:35.967147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.967927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a31401d-7111-4d29-981e-e1785a02e583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:35.970000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 984/1954] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:35 2022] DELETE /identity/v3/projects/74c27d9763fe4e8fa66cd427fd0ab69c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:35.974850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ad2b-4189-4a7a-90fd-64eec6aae4d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.975778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ad2b-4189-4a7a-90fd-64eec6aae4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.976052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ad2b-4189-4a7a-90fd-64eec6aae4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.988870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:35.989978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:35.989978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:35.990390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:35.990930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:35.992878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:35.999062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f369ad2b-4189-4a7a-90fd-64eec6aae4d0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:35.999995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f369ad2b-4189-4a7a-90fd-64eec6aae4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:36.008149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 985/1955] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:36.016030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.016273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.016574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.027129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 971/1956] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:35 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:36.030954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.032693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:36.040102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:36.041285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:36.113979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f9ecb-1a68-4a2b-8401-9e642892d305 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.119409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.120228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.120523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.120934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.121729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.124086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.144726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 986/1957] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:36.149882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.155942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 972/1958] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:36.160562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.176220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81f12-aaea-495e-90e0-3867fa0e439c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.177140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198e96f-b4ee-416a-b834-9772268603b1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.182000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.184009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.184368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.184707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.185170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.185278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.185513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.185797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.186228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.186615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:36.186937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.187993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.188949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.208708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 973/1959] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:36.213559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.217377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 987/1960] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:36.226704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.242318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82a5ca-a6a6-4c69-a904-07b4b2c7807f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.256588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dd22-0f04-412d-ba17-74f26c17a6b7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.259856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.260494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.260772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.261047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.262011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.263853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.264724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.265408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.265759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.266159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.267306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.269448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.286645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 974/1961] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:36.288088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.312643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9555-8250-49d6-ab1c-8d42c4999152 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.317684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.318397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.319202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.319479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] PATH_INFO: `/v3/projects/99a5991b126d433c8a27f591f424df8d/users/ea0fef1c4eca44d1afd3aa1343f18539/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.325794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 988/1962] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:36.328111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.329554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:36.340607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a5991b126d433c8a27f591f424df8d, user_id=ea0fef1c4eca44d1afd3aa1343f18539, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.343518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b55b8-67d4-4588-abd1-2c8c1f7e7999 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.367948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 975/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:36 2022] PUT /identity/v3/projects/99a5991b126d433c8a27f591f424df8d/users/ea0fef1c4eca44d1afd3aa1343f18539/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:36.374587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.375079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.375410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.411744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] MFA Rules not processed for user `ea0fef1c4eca44d1afd3aa1343f18539`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:36.413168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:36.435048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037da854-38d5-4979-937d-9c92380eea17 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.453834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:36.491344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 976/1964] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:36.495922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.498902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.499534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.499818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.500093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.500720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.502742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.506837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7bf9d-25e0-4653-8c1f-2359b093ca5d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.511457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.512062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.512346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.512624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.513279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.515314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.524491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 989/1965] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:36.529822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.539451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ddeb7-9cfb-459f-b1bd-7295c6013272 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.544344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.544947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.545218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.545496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.546198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.550482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 977/1966] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:36.550633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.551774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.558448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 990/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:36.562156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.572534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726ac6-cc16-4f14-9bf7-91c632f5f43e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.614539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d2fd-c271-4156-816b-023e9e9e8841 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.619650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.620266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.620549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.620828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.621457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.623561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.632148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.632756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.633067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.633397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.634102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.636034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.647905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 978/1968] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:36.653414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.656575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 991/1969] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:36.657598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.674629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b00aad-1b53-432c-b06d-f095e96331a0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.681830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.682287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.682575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.682853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.683545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.685198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.698511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 979/1970] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:36.705514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821d79-20c9-4671-bbcf-f8b45462d4ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.706444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.720096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.721027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.721360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.721913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] PATH_INFO: `/v3/projects/178d580e65e346b6a920cda51e465d0f/users/387d18b2e2c44c0abe6c7bf8d7e2efbb/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.723646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195e1b-a0c8-4338-bb59-a945913fa6d2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.729611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.730590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.730976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.731366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] PATH_INFO: `/v3/projects/be7511193bd64098b873baf36e9fbe49/users/acf1564ecf72414ca3ac570aa76d9408/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.764735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178d580e65e346b6a920cda51e465d0f, user_id=387d18b2e2c44c0abe6c7bf8d7e2efbb, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.768261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7511193bd64098b873baf36e9fbe49, user_id=acf1564ecf72414ca3ac570aa76d9408, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.772883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.780302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50fb1-6d44-41ae-9f18-3bf791959656 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.797550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 980/1971] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:36 2022] PUT /identity/v3/projects/be7511193bd64098b873baf36e9fbe49/users/acf1564ecf72414ca3ac570aa76d9408/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:36.802180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.811430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 992/1972] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:36 2022] PUT /identity/v3/projects/178d580e65e346b6a920cda51e465d0f/users/387d18b2e2c44c0abe6c7bf8d7e2efbb/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:36.823399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.823830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.824707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.827394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:36.869637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] MFA Rules not processed for user `387d18b2e2c44c0abe6c7bf8d7e2efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:36.871233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:36.887272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3442-1dad-4513-8a44-cdab52d37feb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.939113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:36.946097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 993/1973] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:36.947511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.950112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.950754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.951036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.951310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.951952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.953545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.958174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaf8d6-3902-42ed-9c1c-ab1db816ab0c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.962674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.963263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.963417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 981/1974] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:36.966758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.967048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.967398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:36.967686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.969617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.977302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da58ba4-b356-4119-89d6-a11edb9ca07e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:36.981844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:36.982514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:36.982794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:36.983069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] PATH_INFO: `/v3/projects/be7511193bd64098b873baf36e9fbe49/users/acf1564ecf72414ca3ac570aa76d9408/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:36.984965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7511193bd64098b873baf36e9fbe49, user_id=acf1564ecf72414ca3ac570aa76d9408, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:36.987615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d8fcb-16d2-495a-942e-36da394dcfb7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:36.999390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 994/1975] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:36 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:37.000835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 982/1976] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:36 2022] PUT /identity/v3/projects/be7511193bd64098b873baf36e9fbe49/users/acf1564ecf72414ca3ac570aa76d9408/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:37.003609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.011093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2200-d107-4300-bbee-be73593a417f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.011383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2200-d107-4300-bbee-be73593a417f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.011669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a2200-d107-4300-bbee-be73593a417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.045090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-814a2200-d107-4300-bbee-be73593a417f None None] MFA Rules not processed for user `acf1564ecf72414ca3ac570aa76d9408`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:37.046444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-814a2200-d107-4300-bbee-be73593a417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:37.078030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8fba-110c-4b30-a183-f193b2548b81 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.083679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.084336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.084688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.084970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.085614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.087732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.114366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 995/1977] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:37 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:37.119129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.131104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 983/1978] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:37.137421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d8bd7-51bc-4066-8b5d-6064d7cec6c9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.142707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.143127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2200-d107-4300-bbee-be73593a417f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.143323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.143611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.143890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.144540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.145388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-814a2200-d107-4300-bbee-be73593a417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:37.146249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.162002 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 996/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:37.166921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.180748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc37-9955-4b71-8986-0d2ac104cc66 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.185636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:37.188061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.189773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.190105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.190467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] PATH_INFO: `/v3/projects/8f6a1d3e7fac4b5591c437609457d6db/users/622f3838bd5e444393d739ccd11e1e08/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.209175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6a1d3e7fac4b5591c437609457d6db, user_id=622f3838bd5e444393d739ccd11e1e08, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.211907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.237445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a2200-d107-4300-bbee-be73593a417f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.241305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 997/1980] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:37 2022] PUT /identity/v3/projects/8f6a1d3e7fac4b5591c437609457d6db/users/622f3838bd5e444393d739ccd11e1e08/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:37.245668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.306219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.306941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.307967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.308458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.335874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c544ff-35d5-424f-8117-d1a3adebf0ab admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.342318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.343102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.343477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.343657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.344566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.346345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.359378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 998/1981] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:37.363952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.376420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc9a6-d61f-4de1-bd34-bddcd35d872e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.382639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.383568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.383931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.384285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] PATH_INFO: `/v3/projects/8f6a1d3e7fac4b5591c437609457d6db/users/622f3838bd5e444393d739ccd11e1e08/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.388107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6a1d3e7fac4b5591c437609457d6db, user_id=622f3838bd5e444393d739ccd11e1e08, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.391694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.395891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.397851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245e31-429c-4a6d-9e6c-5b3a75baa33d service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.408929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 984/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:37.416229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 999/1983] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:37 2022] PUT /identity/v3/projects/8f6a1d3e7fac4b5591c437609457d6db/users/622f3838bd5e444393d739ccd11e1e08/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:37.430198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.430198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.430198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.467509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.472453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] MFA Rules not processed for user `622f3838bd5e444393d739ccd11e1e08`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:37.473780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:37.503318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:37.560653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b07a-4351-4a30-b13d-d32cd4a03b9b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.564794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.565506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.565885 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.566339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.569404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:37.589389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 985/1984] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:37.651813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.654441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.672012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1000/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:37.703575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.706272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:37.725917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2797497-0b28-4cb8-9872-2fbd049ed7af None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.729715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.730389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.731099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.731372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.741537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.743198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.754319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 986/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:37.847786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:37.857917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3f58e-a99d-4c16-ac09-7cc7d698c3b0 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:37.864169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:37.864890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:37.865180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:37.865477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:37.930990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:37.932772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27130-13ea-4315-8be5-365c53227909 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:37.943041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1001/1987] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:39.624815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:39.628348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:39.635246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:39.706189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf692f7-7b52-46cb-8f54-9e710bd78fd3 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:39.711743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:39.718326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:39.718326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:39.718326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] PATH_INFO: `/v3/users/1870b968c7b8436c9c4c297f6bd5694a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:39.718326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1870b968c7b8436c9c4c297f6bd5694a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:39.718326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:39.782444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1870b968c7b8436c9c4c297f6bd5694a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:39.782995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1870b968c7b8436c9c4c297f6bd5694a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:39.790738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1870b968c7b8436c9c4c297f6bd5694a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:39.804579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1870b968c7b8436c9c4c297f6bd5694a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:39.805302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1870b968c7b8436c9c4c297f6bd5694a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:39.818038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 987/1988] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:39 2022] DELETE /identity/v3/users/1870b968c7b8436c9c4c297f6bd5694a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:39.822678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:39.823156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:39.823522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:39.843900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:39.845084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:39.913850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1002/1989] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:39.923694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:39.925228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:39.982901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489995d3-c5d7-43e5-8a78-15ee7c60c67a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:39.986456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:39.987064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:39.987342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:39.987637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:39.997077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:39.998525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35b2bb-092b-4d05-9f45-b79deba38e53 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:40.008175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 988/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:40.464190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:40.465884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:40.480475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83c93-c7d1-467f-b30d-2b5e575fe79b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:40.486036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:40.486909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.487298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.487682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] PATH_INFO: `/v3/projects/dd09a3b093ff4a67bca7466879352776` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.488965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd09a3b093ff4a67bca7466879352776)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:40.491267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:40.493911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:40.541752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd09a3b093ff4a67bca7466879352776', 'request_id': 'req-1d046f31-944e-4835-b210-2ab014b5d679'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:40.549514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd09a3b093ff4a67bca7466879352776', 'request_id': 'req-1d046f31-944e-4835-b210-2ab014b5d679'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:40.556420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd09a3b093ff4a67bca7466879352776', 'request_id': 'req-1d046f31-944e-4835-b210-2ab014b5d679'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:40.570127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] The token cache is being invalidate because project dd09a3b093ff4a67bca7466879352776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:40.570424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:40.571120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1d046f31-944e-4835-b210-2ab014b5d679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:40.572608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1003/1991] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:40 2022] DELETE /identity/v3/projects/dd09a3b093ff4a67bca7466879352776 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:40.577608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.577927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.578239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.598351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:40.599564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:40.619897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:40.670516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 989/1992] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:40.678666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.679035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.679270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.738420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:40.739993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:40.754198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1004/1993] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:40.759613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:40.770568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e1bff-9923-41f7-a3f4-ec977e27036a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:40.794681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:40.795553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.798186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.799424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.801510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:40.803019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:40.810227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:40.811415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:40.819505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:40.832877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df244e71-2955-47a3-a92d-15b342affe90 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:40.858817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:40.859587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.859867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.860139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] PATH_INFO: `/v3/users/b3bb49dcaab9412594681b893c1618f5` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.868676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bb49dcaab9412594681b893c1618f5)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:40.870670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:40.871072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 990/1994] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:40.871976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:40.901449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a75b70-8053-4661-96ae-023fab794498 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:40.919461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:40.920195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:40.920499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:40.920900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:40.921969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:40.924798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:40.982615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 991/1995] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:40 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:40.986504 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.001115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bb49dcaab9412594681b893c1618f5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:41.001892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bb49dcaab9412594681b893c1618f5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:41.015644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bb49dcaab9412594681b893c1618f5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:41.036048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bb49dcaab9412594681b893c1618f5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:41.036736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3405c74d-eca4-4874-aef0-ea688b8fc2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bb49dcaab9412594681b893c1618f5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:41.058084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1005/1996] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:40 2022] DELETE /identity/v3/users/b3bb49dcaab9412594681b893c1618f5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:41.062869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.064019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.064470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.105674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:41.109332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.114045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0df59-e303-47e4-bc68-3c6f6bee3523 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.180392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.181002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.181278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.181550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.182205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.184118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.206477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:41.213748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 992/1997] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:40 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:41.217722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.219877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.234390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1006/1998] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:41.245685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09f4a0-3bd8-4e8b-85fb-5fe77dc67b5e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.250863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.251476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.251757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.252017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.260028 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.261847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.267312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.269268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.308897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 993/1999] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:41.311046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.325433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c017-7155-4014-bd2b-bd7c6d7e94b2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.333195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.333868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.334179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.334518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.335930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.337626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.353088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 994/2000] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:41.361171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.376749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:41.381501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784e6a-449f-45fe-9629-4fbe3626b58a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.387142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.388261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.388673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.389052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] PATH_INFO: `/v3/projects/6b9b4fa628b348928896651e0cabb6b6/users/21e9af31cec248909d2395d6db7ca990/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.406106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9b4fa628b348928896651e0cabb6b6, user_id=21e9af31cec248909d2395d6db7ca990, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.407388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e520dc-358a-4b1f-aa2d-b138782a408b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.409730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0e9b-d8a4-4ab1-b81f-71faa0caeb3d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.411679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.412344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.413148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.413395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.431665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 995/2001] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:41 2022] PUT /identity/v3/projects/6b9b4fa628b348928896651e0cabb6b6/users/21e9af31cec248909d2395d6db7ca990/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:41.443936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.444300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.444650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.460102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.461595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.489601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1007/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:41.491183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] MFA Rules not processed for user `21e9af31cec248909d2395d6db7ca990`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:41.492560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.598168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 996/2003] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:41.612351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.614263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.694767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52033fbc-2119-47cf-9ab7-7aa5904226bb service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.756242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.756863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.757273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.757898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.768206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.769654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.780837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1008/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:41.811781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.877417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:41.878919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:41.939316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c2e3-96b9-41a2-8fa3-025aa7a3a0de None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:41.948125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:41.948788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:41.949072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:41.949351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] PATH_INFO: `/v3/users/21e9af31cec248909d2395d6db7ca990` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:41.951575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e9af31cec248909d2395d6db7ca990)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:41.953932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:41.999334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740c5e-1187-4760-a70f-11e49b38c544 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.005335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.006177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.006532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.006881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] PATH_INFO: `/v3/projects/553f192310b94f679d8cf5c6f78850e7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.008100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553f192310b94f679d8cf5c6f78850e7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.010270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.011955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:42.021331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e9af31cec248909d2395d6db7ca990'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.022617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e9af31cec248909d2395d6db7ca990'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.033680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e9af31cec248909d2395d6db7ca990'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.046286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:42.048243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e9af31cec248909d2395d6db7ca990'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.049295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e9af31cec248909d2395d6db7ca990'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.065340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 997/2005] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:41 2022] DELETE /identity/v3/users/21e9af31cec248909d2395d6db7ca990 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:42.068323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.068512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553f192310b94f679d8cf5c6f78850e7', 'request_id': 'req-32790c30-0788-403a-8d26-3038e0354c85'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.069135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.076470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553f192310b94f679d8cf5c6f78850e7', 'request_id': 'req-32790c30-0788-403a-8d26-3038e0354c85'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.084074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553f192310b94f679d8cf5c6f78850e7', 'request_id': 'req-32790c30-0788-403a-8d26-3038e0354c85'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.097387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] The token cache is being invalidate because project 553f192310b94f679d8cf5c6f78850e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:42.097707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.098387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32790c30-0788-403a-8d26-3038e0354c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.099904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1009/2006] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:41 2022] DELETE /identity/v3/projects/553f192310b94f679d8cf5c6f78850e7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:42.105243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.105532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.105808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.128480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:42.129685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.143922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535ac0-e229-4bfc-8ae7-4e0da05e6661 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.151070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.151788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.152150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.152488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] PATH_INFO: `/v3/users/387d18b2e2c44c0abe6c7bf8d7e2efbb` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.153722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387d18b2e2c44c0abe6c7bf8d7e2efbb)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.155740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.217311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387d18b2e2c44c0abe6c7bf8d7e2efbb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.218352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387d18b2e2c44c0abe6c7bf8d7e2efbb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.220395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1010/2007] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:42.224435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.225848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.246235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387d18b2e2c44c0abe6c7bf8d7e2efbb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.246414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3cbef-9d6d-4266-89ff-dc5a46283d8e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.246414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.246414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.246414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.246966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] PATH_INFO: `/v3/users/ea0fef1c4eca44d1afd3aa1343f18539` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.246966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0fef1c4eca44d1afd3aa1343f18539)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.248239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.255602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387d18b2e2c44c0abe6c7bf8d7e2efbb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.257240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387d18b2e2c44c0abe6c7bf8d7e2efbb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.289112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 998/2008] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:42 2022] DELETE /identity/v3/users/387d18b2e2c44c0abe6c7bf8d7e2efbb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:42.290604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.292850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.315783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0fef1c4eca44d1afd3aa1343f18539'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.316511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0fef1c4eca44d1afd3aa1343f18539'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.324676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0fef1c4eca44d1afd3aa1343f18539'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.337986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0fef1c4eca44d1afd3aa1343f18539'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.338717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac274108-4375-4fa0-8195-3b023d967419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0fef1c4eca44d1afd3aa1343f18539'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.352181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1011/2009] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:42 2022] DELETE /identity/v3/users/ea0fef1c4eca44d1afd3aa1343f18539 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:42.353611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.353909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.354230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.356959 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527ff43-2baa-4216-9443-21b29c1c9656 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.362079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:42.378176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:42.380011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.383884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:42.434417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.435799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.436338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.436788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.439887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.476062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1012/2010] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:42.477300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.479022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.529899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.531384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.559738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 999/2011] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:42.560478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.562543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.579430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046e5b-c51c-425f-952e-19cfb8c94418 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.583866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.584808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.585231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.585647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.586949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac6b5d-99bd-4f1b-9039-5fe1435f3839 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.596724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.597445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.597820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.598791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.599384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.599735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.601842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.612079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1000/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:42.694807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.696272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.708052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1013/2013] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:42.789368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.791181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:42.814836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31c28b-5d6e-45b0-810b-56aab6d43909 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:42.825177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:42.826505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:42.827090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:42.827511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] PATH_INFO: `/v3/projects/99a5991b126d433c8a27f591f424df8d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:42.830094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a5991b126d433c8a27f591f424df8d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:42.834659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:42.923466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a5991b126d433c8a27f591f424df8d', 'request_id': 'req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.940363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a5991b126d433c8a27f591f424df8d', 'request_id': 'req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.951728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a5991b126d433c8a27f591f424df8d', 'request_id': 'req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.966349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] The token cache is being invalidate because project 99a5991b126d433c8a27f591f424df8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:42.966774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.968334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:42.970083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1001/2014] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:42 2022] DELETE /identity/v3/projects/99a5991b126d433c8a27f591f424df8d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:42.974436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:42.991769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818e45-0187-458a-aa23-a98d22385141 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.053717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:43.066509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.067328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.067682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.068089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] PATH_INFO: `/v3/users/acf1564ecf72414ca3ac570aa76d9408` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.069336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf1564ecf72414ca3ac570aa76d9408)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.071426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.086980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.088445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.108981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8a87-17f3-4cfd-84d2-9d031d51ebd1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.117002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.118034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.118396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.118848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] PATH_INFO: `/v3/projects/6b9b4fa628b348928896651e0cabb6b6` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.120847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9b4fa628b348928896651e0cabb6b6)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.124215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.140781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf1564ecf72414ca3ac570aa76d9408'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.142109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf1564ecf72414ca3ac570aa76d9408'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.150215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf1564ecf72414ca3ac570aa76d9408'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.163376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf1564ecf72414ca3ac570aa76d9408'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.164106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf1564ecf72414ca3ac570aa76d9408'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.179627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1014/2015] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:42 2022] DELETE /identity/v3/users/acf1564ecf72414ca3ac570aa76d9408 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:43.180536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.181855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.191830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:43.204754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9b4fa628b348928896651e0cabb6b6', 'request_id': 'req-317a8d6a-6d55-4f08-85bb-9735ca4698ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.218961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9b4fa628b348928896651e0cabb6b6', 'request_id': 'req-317a8d6a-6d55-4f08-85bb-9735ca4698ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.231037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9b4fa628b348928896651e0cabb6b6', 'request_id': 'req-317a8d6a-6d55-4f08-85bb-9735ca4698ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.246881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] The token cache is being invalidate because project 6b9b4fa628b348928896651e0cabb6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:43.247431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.248568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-317a8d6a-6d55-4f08-85bb-9735ca4698ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.250635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1002/2016] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:43 2022] DELETE /identity/v3/projects/6b9b4fa628b348928896651e0cabb6b6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:43.270590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054651d-f58d-45ee-b911-c1038fb04a1b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.273014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054651d-f58d-45ee-b911-c1038fb04a1b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.273463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054651d-f58d-45ee-b911-c1038fb04a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.299529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae57bf-f9bf-482a-8f70-c87b7da6ce0f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.305483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.306485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.307171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.307644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] PATH_INFO: `/v3/projects/178d580e65e346b6a920cda51e465d0f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.308992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6054651d-f58d-45ee-b911-c1038fb04a1b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:43.309333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=178d580e65e346b6a920cda51e465d0f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.310431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6054651d-f58d-45ee-b911-c1038fb04a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.312037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.338235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1003/2017] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:43.344804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.345749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.346232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.385051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:43.386561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.390577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178d580e65e346b6a920cda51e465d0f', 'request_id': 'req-884ab213-0b23-4fba-af10-9281099c9f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.405239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178d580e65e346b6a920cda51e465d0f', 'request_id': 'req-884ab213-0b23-4fba-af10-9281099c9f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.426961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178d580e65e346b6a920cda51e465d0f', 'request_id': 'req-884ab213-0b23-4fba-af10-9281099c9f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.451465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] The token cache is being invalidate because project 178d580e65e346b6a920cda51e465d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:43.451842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.455128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.456892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1015/2018] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:43 2022] DELETE /identity/v3/projects/178d580e65e346b6a920cda51e465d0f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:43.462121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.464715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.465536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1004/2019] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:43.469462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.479284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:43.481983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df02bd-7aca-41e4-b9ff-5f997cb4ac71 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.488060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab213-0b23-4fba-af10-9281099c9f1f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.488559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.489231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.489468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.489962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.490810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:43.491123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.494255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.496322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.497153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.497559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.498521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] PATH_INFO: `/v3/users/622f3838bd5e444393d739ccd11e1e08` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.499820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622f3838bd5e444393d739ccd11e1e08)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.503961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.512011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1005/2020] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:43:43.517805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.529983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e3b4-f2cb-4b5c-9d6d-f4aa89968a97 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.539598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.540225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.540505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.540782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.541451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.543653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.570359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622f3838bd5e444393d739ccd11e1e08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.571040 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622f3838bd5e444393d739ccd11e1e08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.579882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622f3838bd5e444393d739ccd11e1e08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.593696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622f3838bd5e444393d739ccd11e1e08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.594368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622f3838bd5e444393d739ccd11e1e08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.599088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1006/2021] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:43 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:43.600957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.602956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.622752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1016/2022] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:43 2022] DELETE /identity/v3/users/622f3838bd5e444393d739ccd11e1e08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:43.623549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.625139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:43.716944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df79f7-f55e-4c0f-822d-97763860d7f5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.749893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122749b-1727-4902-b21b-a1d9c7f46842 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.758830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.760031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.760722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.761115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.761860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.764555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.771681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:43.798092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1017/2023] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:43 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:43.802324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.814680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.815787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.815787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.816407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] PATH_INFO: `/v3/projects/be7511193bd64098b873baf36e9fbe49` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.817364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7511193bd64098b873baf36e9fbe49)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.820101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.828910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2243db-34f5-4fc4-8d56-bb23b430d054 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.846035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:43.846700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.846984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.847259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:43.847913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:43.849769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:43.864828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1018/2024] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:43.870331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:43.912938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd45c4-eaff-4192-9c46-cdaecc6269f3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:43.920050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7511193bd64098b873baf36e9fbe49', 'request_id': 'req-c4724430-965b-4067-ba92-0f5e47c1105e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.931036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7511193bd64098b873baf36e9fbe49', 'request_id': 'req-c4724430-965b-4067-ba92-0f5e47c1105e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.949784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7511193bd64098b873baf36e9fbe49', 'request_id': 'req-c4724430-965b-4067-ba92-0f5e47c1105e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.982429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] The token cache is being invalidate because project be7511193bd64098b873baf36e9fbe49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:43.982625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.983720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c4724430-965b-4067-ba92-0f5e47c1105e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:43.985887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1007/2025] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:43 2022] DELETE /identity/v3/projects/be7511193bd64098b873baf36e9fbe49 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:43.991154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:43.993283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:43.994146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:43.994146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.007074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.007745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.008069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.008338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.009011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.013006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.028271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.029502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.041327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1019/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:44.041327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.042696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.043159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1008/2027] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:44.044525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.045860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.056350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ec3a-c582-4fc1-8f85-bcda01d1b5f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.061161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.061789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.062109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.062511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] PATH_INFO: `/v3/projects/8f6a1d3e7fac4b5591c437609457d6db` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.064070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6a1d3e7fac4b5591c437609457d6db)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.066062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.070789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3878d-2cd3-4e5b-a874-b70387d71ff6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.076115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.076955 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.077240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.077531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] PATH_INFO: `/v3/projects/ce4a624198974147b832f7e67ca5612d/users/ebcc353410b54ffd926f869e5cafc7dd/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.099224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4a624198974147b832f7e67ca5612d, user_id=ebcc353410b54ffd926f869e5cafc7dd, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.099224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c40e2-4731-41d6-aff2-bbd05bf76e4c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.113389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1009/2028] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:44 2022] PUT /identity/v3/projects/ce4a624198974147b832f7e67ca5612d/users/ebcc353410b54ffd926f869e5cafc7dd/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:44.119693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0660f-265f-45b7-8e69-0fe274c50664 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.120468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0660f-265f-45b7-8e69-0fe274c50664 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.121062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0660f-265f-45b7-8e69-0fe274c50664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.121608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6a1d3e7fac4b5591c437609457d6db', 'request_id': 'req-cda57835-eb58-45c8-81a9-86d83a5e3285'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:44.131927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6a1d3e7fac4b5591c437609457d6db', 'request_id': 'req-cda57835-eb58-45c8-81a9-86d83a5e3285'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:44.140692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6a1d3e7fac4b5591c437609457d6db', 'request_id': 'req-cda57835-eb58-45c8-81a9-86d83a5e3285'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:44.145479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bff0660f-265f-45b7-8e69-0fe274c50664 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.146604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bff0660f-265f-45b7-8e69-0fe274c50664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.153873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] The token cache is being invalidate because project 8f6a1d3e7fac4b5591c437609457d6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:44.154179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:44.154840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cda57835-eb58-45c8-81a9-86d83a5e3285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:44.156748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:44 2022] DELETE /identity/v3/projects/8f6a1d3e7fac4b5591c437609457d6db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:44.159501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.160020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.160484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.192630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] MFA Rules not processed for user `ebcc353410b54ffd926f869e5cafc7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.194586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.217094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1010/2030] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:44.218478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.218767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.219045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.239720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.241452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.249978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1011/2031] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:44.250740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.261704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a6516-2fef-4907-b9f0-af1cf81f87ff None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.276611 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.277384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.277710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.277934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.278787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:44.279094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.280787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91451-fe26-4442-90c7-896aa512d829 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.297459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1012/2032] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:44.297459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.297459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.297459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.311045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1021/2033] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:44.311955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.315936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.317071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.326810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1013/2034] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:44.327740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.329099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.330594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96822001-36a9-4892-878d-c179fc1e4660 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.335969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.336581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.336860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.337142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.337782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.339797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.341055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:44.370634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1022/2035] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:44.372116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.394510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53e50b-12da-456d-a398-523a5c6e5eba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.417229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:44.438742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57955e8b-d49f-4f12-828b-18b8fd1b7f91 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.445774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.446428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.446706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.446978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.447658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:44.447892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.448003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.448619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.448903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.449181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.449573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.462783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1023/2036] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:44.462783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.473547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befecd4-108a-470d-96d1-4067ac7a6a9a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.478225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.478817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.479098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.479372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.479995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.481886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.503711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1024/2037] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:44.504497 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.509770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.511277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.517408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9ed39-97dd-4419-8a83-4ecaaf2560cc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.521030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1014/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:44.521729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.522990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.523777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.524639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.525055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.526180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.529606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.533052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1cead-a7aa-426d-acb2-7e1e708824f2 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.538102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.538678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.538996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.539279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.539929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.544202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.556714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1015/2039] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:44.560853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.567753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1025/2040] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:44.569488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.571561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11b65-87e8-4153-abc6-74f7921d9a7c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.642628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.643389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.644984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.645346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.646168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.648340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.648456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690a56-28eb-45c9-a853-6648ea594244 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.654445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.655057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.655344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.655618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.656285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.658222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.661847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1016/2041] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:44.663118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.670837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:44.676908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43550-7b8a-4686-81cd-38862ee482ee admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.682092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.682916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.683230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1026/2042] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:44.686046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.686342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] PATH_INFO: `/v3/projects/5d8112c490aa4993ab4592c5f0a898a1/users/83bd1be6fd6241129af0a5f4686331f0/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.686827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.697843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83d47-c1fe-4179-b363-0fe81fdf9d66 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.702671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.703297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.703417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8112c490aa4993ab4592c5f0a898a1, user_id=83bd1be6fd6241129af0a5f4686331f0, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.703598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.703848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.704487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.706165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027ff30-8a59-4536-a615-4493d8232e67 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.706288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.717443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1027/2043] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:44.721267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1017/2044] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:44 2022] PUT /identity/v3/projects/5d8112c490aa4993ab4592c5f0a898a1/users/83bd1be6fd6241129af0a5f4686331f0/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:44.721570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.732697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.733042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.733320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.735169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bbc48-8e43-4241-9426-2b5e4578116b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.765622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] MFA Rules not processed for user `83bd1be6fd6241129af0a5f4686331f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.766862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:44.803315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.804392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.804799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.805075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.805716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.807648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.818780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1028/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:44.823117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.836925 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a3f13-5759-4b8d-a212-165aa6fc6b45 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.842014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1018/2046] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:44.844138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.844866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.845180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.845418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] PATH_INFO: `/v3/projects/d280bbb6066f4c9682685d99d39135d7/users/b224c05fe97a4146aa71addae7c86763/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.846719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.849192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:44.860263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c93526-bca7-4811-9f71-d9084a841f81 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:44.865351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:44.865861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d280bbb6066f4c9682685d99d39135d7, user_id=b224c05fe97a4146aa71addae7c86763, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.866771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.866771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.866771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.867363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:44.868995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62e02-6d10-4d48-8806-c3c78e4eec8c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.869370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:44.896388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1029/2047] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:44 2022] PUT /identity/v3/projects/d280bbb6066f4c9682685d99d39135d7/users/b224c05fe97a4146aa71addae7c86763/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:44.907883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:44.908577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:44.908891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:44.929856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1019/2048] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:44.931024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:44.977682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] MFA Rules not processed for user `b224c05fe97a4146aa71addae7c86763`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:44.978230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:45.065626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e073eeb-643d-45f9-9426-84301cca7394 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.066071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1030/2049] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:45.071235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.076491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.077114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.077397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.077671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.078405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.080621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.081858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa62343-f1e9-408d-b90b-99d310b5591e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.086652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.087255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.087535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.087805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.088436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.090368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.105990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1020/2050] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:44 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:45.109711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.121494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbfc9d-bf29-49f4-a2d6-b7a5d865e2b9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.123903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1031/2051] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:45 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:45.127852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.157720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:45.186964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.187582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.187861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.188132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.188779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.190410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.197413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345043-dbd8-4caa-aebe-0ca11c7373d3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.200470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1021/2052] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:45.202180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.202776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.203056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.203326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.203948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.204226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.205857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.213626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61626-50ab-4591-8dec-ff95c3c628f0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.218460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.219136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.219420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.219691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] PATH_INFO: `/v3/projects/077f95dfe5174166827c70f46c111f2c/users/a9c762616ac44a4596856e6a1754c9e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.227469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1032/2053] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:45 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:45.231400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.235658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=077f95dfe5174166827c70f46c111f2c, user_id=a9c762616ac44a4596856e6a1754c9e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.238703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.241711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb13d-c688-48b1-8c36-6c7174cec1a6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.246633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.247445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.247629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.247901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.248537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.250203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.252367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1022/2054] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:45 2022] PUT /identity/v3/projects/077f95dfe5174166827c70f46c111f2c/users/a9c762616ac44a4596856e6a1754c9e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:45.256480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.261280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1033/2055] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:45.270406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.276380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5786bd-b35e-4f4d-8346-ba83c548617f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.318942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:45.335962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7af25d-7501-4d52-9ee1-e777f106a67f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.341694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.342567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.342893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.343188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.343751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.346105 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.357467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1023/2056] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:45.360009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.360777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.361108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.361389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] PATH_INFO: `/v3/projects/3d89ab0936fd4ffea46752462bb73777/users/574eb487761948ffa37881ad0f1a6451/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.362102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.373362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d0df-5680-49d6-b055-dd160bd2c87e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.378429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.379481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.379898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.380387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] PATH_INFO: `/v3/projects/077f95dfe5174166827c70f46c111f2c/users/a9c762616ac44a4596856e6a1754c9e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.381977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d89ab0936fd4ffea46752462bb73777, user_id=574eb487761948ffa37881ad0f1a6451, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.382404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=077f95dfe5174166827c70f46c111f2c, user_id=a9c762616ac44a4596856e6a1754c9e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.384777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.385031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09096e15-9755-4327-b04a-07642e186edd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.397047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1024/2057] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:45 2022] PUT /identity/v3/projects/077f95dfe5174166827c70f46c111f2c/users/a9c762616ac44a4596856e6a1754c9e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:45.406463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1034/2058] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:45 2022] PUT /identity/v3/projects/3d89ab0936fd4ffea46752462bb73777/users/574eb487761948ffa37881ad0f1a6451/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:45.408490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.411265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.411265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.411752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.441760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] MFA Rules not processed for user `a9c762616ac44a4596856e6a1754c9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:45.443142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:45.487164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bc22-73b6-42c9-a92a-6fd2acfefda8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.493703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.494725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.495084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.495429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.496079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.497901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.509386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1035/2059] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:45.514429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.520648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1025/2060] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:45.524396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dbd18-b835-4332-865d-2f1940a664b7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.532731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.533293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.534178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.534464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.534791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] PATH_INFO: `/v3/projects/3d89ab0936fd4ffea46752462bb73777/users/574eb487761948ffa37881ad0f1a6451/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.536704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d89ab0936fd4ffea46752462bb73777, user_id=574eb487761948ffa37881ad0f1a6451, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.540365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467ebbb-0ede-4fb1-bdcb-509bfea92af5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.551664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:45.551967 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1036/2061] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:45 2022] PUT /identity/v3/projects/3d89ab0936fd4ffea46752462bb73777/users/574eb487761948ffa37881ad0f1a6451/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:45.562883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.563175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.563442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.594380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940a988-17b1-46d2-a1e3-302056db637b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.594788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] MFA Rules not processed for user `574eb487761948ffa37881ad0f1a6451`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:45.596637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:45.658527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.659317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.659605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.660128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.682017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1037/2062] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:45.694791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:45.697418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:45.710325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47c00d-eaab-4452-9c0f-36d2f6717c8e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:45.714607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:45.715211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:45.715496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:45.715770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:45.724990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.726472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.736071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1038/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:45.743159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:45.746446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:45.757240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1026/2064] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:46.425873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:46.441530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:46.552941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a152efa-0bc4-4faf-9d5d-6bbf27c0563a service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:46.577292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:46.578973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:46.579366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:46.580634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] PATH_INFO: `/v3/users/83bd1be6fd6241129af0a5f4686331f0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:46.583966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bd1be6fd6241129af0a5f4686331f0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:46.586303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:46.659698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bd1be6fd6241129af0a5f4686331f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.660804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bd1be6fd6241129af0a5f4686331f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.677590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bd1be6fd6241129af0a5f4686331f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.680087 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:46.693811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bd1be6fd6241129af0a5f4686331f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.694562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-42030cdc-7c40-40f6-9443-4e810d9a4b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bd1be6fd6241129af0a5f4686331f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.700012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65ee85-b02f-464c-bbb2-364ed0bbb1c5 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:46.706085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:46.706736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:46.707001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:46.707280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] PATH_INFO: `/v3/users/b224c05fe97a4146aa71addae7c86763` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:46.708403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b224c05fe97a4146aa71addae7c86763)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:46.709711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1039/2065] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:46 2022] DELETE /identity/v3/users/83bd1be6fd6241129af0a5f4686331f0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:46.710739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:46.714458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:46.714813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:46.715169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:46.735834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:46.737291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:46.765913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b224c05fe97a4146aa71addae7c86763'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.767250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b224c05fe97a4146aa71addae7c86763'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.776629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b224c05fe97a4146aa71addae7c86763'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.790121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b224c05fe97a4146aa71addae7c86763'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.791090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7d1390f-8881-4a47-aeb5-34f5a75bcaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b224c05fe97a4146aa71addae7c86763'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:46.793638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:46.810508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1027/2066] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:46 2022] DELETE /identity/v3/users/b224c05fe97a4146aa71addae7c86763 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:46.815401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:46.815964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:46.816214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1040/2067] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:46.816438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:46.827183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:46.828865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:46.846488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:46.848030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:46.870992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:46.918201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd11a-edd8-456b-9b5f-8e347cc3c153 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:46.932624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1028/2068] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:46.942008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:46.982186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:46.982783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:46.983071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:46.983399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:46.996270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:46.998280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:47.011033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1041/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:47.037086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570292c-fb91-489b-8898-e0ef2f33d995 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:47.043507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:47.044367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:47.044658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:47.044939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:47.057406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:47.058922 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:47.072413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1029/2070] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:47.480374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:47.481867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:47.500510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b2e0-14cd-4c8e-a110-2450101f7fdd service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:47.512583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:47.513240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:47.513518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:47.513859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] PATH_INFO: `/v3/projects/d280bbb6066f4c9682685d99d39135d7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:47.515225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d280bbb6066f4c9682685d99d39135d7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:47.518427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:47.583288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd280bbb6066f4c9682685d99d39135d7', 'request_id': 'req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.593029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd280bbb6066f4c9682685d99d39135d7', 'request_id': 'req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.599996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd280bbb6066f4c9682685d99d39135d7', 'request_id': 'req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.619913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] The token cache is being invalidate because project d280bbb6066f4c9682685d99d39135d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:47.620944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.622076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.624043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1042/2071] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:47 2022] DELETE /identity/v3/projects/d280bbb6066f4c9682685d99d39135d7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:47.628386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:47.644835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb384d7-f899-4ab8-8ba1-38a3b8be82cd service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:47.645629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:47.647912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:47.766261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:47.767764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:47.768709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:47.769390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] PATH_INFO: `/v3/users/574eb487761948ffa37881ad0f1a6451` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:47.771348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=574eb487761948ffa37881ad0f1a6451)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:47.773906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:47.829977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40177d9-f13f-4dc3-84cf-f12f5ac2e97b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:47.833074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:47.834142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:47.834601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:47.834995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] PATH_INFO: `/v3/projects/5d8112c490aa4993ab4592c5f0a898a1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:47.836858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8112c490aa4993ab4592c5f0a898a1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:47.843714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:47.856811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:47.863431 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574eb487761948ffa37881ad0f1a6451'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.864592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574eb487761948ffa37881ad0f1a6451'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.885111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574eb487761948ffa37881ad0f1a6451'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.888303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:47.913505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574eb487761948ffa37881ad0f1a6451'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.914493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574eb487761948ffa37881ad0f1a6451'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.934373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1030/2072] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:47 2022] DELETE /identity/v3/users/574eb487761948ffa37881ad0f1a6451 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:47.972364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8112c490aa4993ab4592c5f0a898a1', 'request_id': 'req-39e06290-a83a-43e7-9263-dfbd082deb82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.985185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8112c490aa4993ab4592c5f0a898a1', 'request_id': 'req-39e06290-a83a-43e7-9263-dfbd082deb82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:47.995867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8112c490aa4993ab4592c5f0a898a1', 'request_id': 'req-39e06290-a83a-43e7-9263-dfbd082deb82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.032233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] The token cache is being invalidate because project 5d8112c490aa4993ab4592c5f0a898a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:48.032906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.042327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.044870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1043/2073] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:47 2022] DELETE /identity/v3/projects/5d8112c490aa4993ab4592c5f0a898a1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:48.049220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:48.050901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:48.176894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc30f-a928-49a2-b652-598d587592cb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:48.307580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:48.308322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.308957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.309315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] PATH_INFO: `/v3/users/a9c762616ac44a4596856e6a1754c9e1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.310953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c762616ac44a4596856e6a1754c9e1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:48.313020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:48.386906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:48.388858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:48.392505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c762616ac44a4596856e6a1754c9e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.393662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c762616ac44a4596856e6a1754c9e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.409596 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06290-a83a-43e7-9263-dfbd082deb82 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:48.417084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:48.417084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.417318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.417543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] PATH_INFO: `/v3/projects/3d89ab0936fd4ffea46752462bb73777` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.418650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d89ab0936fd4ffea46752462bb73777)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:48.420461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c762616ac44a4596856e6a1754c9e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.420581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:48.433654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:48.446456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c762616ac44a4596856e6a1754c9e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.451254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-548d96e9-b82c-4710-8100-7f675887a0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c762616ac44a4596856e6a1754c9e1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.474419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1031/2074] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:48 2022] DELETE /identity/v3/users/a9c762616ac44a4596856e6a1754c9e1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:48.487992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d89ab0936fd4ffea46752462bb73777', 'request_id': 'req-ce6cb001-eeb9-406d-ab43-b6257649547d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.500205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d89ab0936fd4ffea46752462bb73777', 'request_id': 'req-ce6cb001-eeb9-406d-ab43-b6257649547d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.511990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d89ab0936fd4ffea46752462bb73777', 'request_id': 'req-ce6cb001-eeb9-406d-ab43-b6257649547d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.544869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] The token cache is being invalidate because project 3d89ab0936fd4ffea46752462bb73777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:48.546655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.549042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce6cb001-eeb9-406d-ab43-b6257649547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:48.552403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1044/2075] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:48 2022] DELETE /identity/v3/projects/3d89ab0936fd4ffea46752462bb73777 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:48.558082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.558395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.558796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.596119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:48.599898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:48.748004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1032/2076] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:48.758015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.758403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.758776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.795332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:48.800727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:48.825329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1045/2077] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:48.829989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:48.863936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5aa99-9337-46b2-81ee-26c16390b037 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:48.870997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:48.871813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.872124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.872478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.873122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:48.874169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:48.875788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:48.920618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1033/2078] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:43:48.925419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:48.935356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:48.938247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:48.946472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db823e7-aa50-4236-bcce-279b4133b008 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:48.957573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a4051-d2e7-4568-bcd4-85fd893083d6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:48.959809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:48.960545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.961306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.962080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.963286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:48.966023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:48.972056 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:48.972939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:48.973295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:48.973640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] PATH_INFO: `/v3/projects/077f95dfe5174166827c70f46c111f2c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:48.976117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077f95dfe5174166827c70f46c111f2c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:48.978646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.027238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1046/2079] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:48 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:49.028755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.079905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077f95dfe5174166827c70f46c111f2c', 'request_id': 'req-f114b810-bcd3-47a7-bec7-79ff716bba60'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:49.091381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077f95dfe5174166827c70f46c111f2c', 'request_id': 'req-f114b810-bcd3-47a7-bec7-79ff716bba60'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:49.102648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077f95dfe5174166827c70f46c111f2c', 'request_id': 'req-f114b810-bcd3-47a7-bec7-79ff716bba60'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:49.114740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:49.115077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] The token cache is being invalidate because project 077f95dfe5174166827c70f46c111f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:49.115532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:49.119241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f114b810-bcd3-47a7-bec7-79ff716bba60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:49.121021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3a5a-3a33-4166-9f2a-0978ead08634 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.124664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1034/2080] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:48 2022] DELETE /identity/v3/projects/077f95dfe5174166827c70f46c111f2c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:49.129525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d2de-f324-4a8c-a884-b89059fea53b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.129893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d2de-f324-4a8c-a884-b89059fea53b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.130196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d2de-f324-4a8c-a884-b89059fea53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.157758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4207d2de-f324-4a8c-a884-b89059fea53b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:49.159272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4207d2de-f324-4a8c-a884-b89059fea53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:49.222531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:49.235982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.236554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.236827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.237101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.238024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.240846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.263488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1035/2081] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:49.273836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.280282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1047/2082] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:49.280445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.280445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.291371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.294866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:49.310413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3c47-306b-4326-8678-35b2fab31203 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.319566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.320409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.320853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.321362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.322003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.324476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.330123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:49.332438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:49.341992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1048/2083] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:49.344984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.349476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1036/2084] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:49.355586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.372574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f231-e721-48d0-84c4-ccf3e58897ea admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.377653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.378568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.378856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.379137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.379789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.381447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.382740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab8492-3cc5-4733-a8cd-e05ec337ccf3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.397987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1049/2085] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:49.400572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.401052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.401196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.401481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.401752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.402544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:49.402940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.404582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.414878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e36c-9d1c-41f7-b462-f48ad3ca6de1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.423279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1037/2086] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:49.423402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.423402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.423402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.423402 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] PATH_INFO: `/v3/projects/7d756a74dad14fe482ebf847a57d14c9/users/b9616a1d9a1f464499a31c9a17fb7400/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.424121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.434486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28756c-f65f-49fa-b16f-9bf5e4f923c7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.439921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.440568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.440830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.441257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.441896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.443875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.461655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d756a74dad14fe482ebf847a57d14c9, user_id=b9616a1d9a1f464499a31c9a17fb7400, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.465136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f909886-7647-47db-9166-7e7d190de277 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.480207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1038/2087] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:49.484429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1050/2088] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:49 2022] PUT /identity/v3/projects/7d756a74dad14fe482ebf847a57d14c9/users/b9616a1d9a1f464499a31c9a17fb7400/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:49.493271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.494880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.495344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.495662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.533876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] MFA Rules not processed for user `b9616a1d9a1f464499a31c9a17fb7400`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:49.538863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:49.591823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c193c0-7721-4ada-8d10-748901b5d31f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.597487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.598156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.598441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.599419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.601293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.603665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.632808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1039/2089] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:49.638104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1051/2090] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:49.639835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.648073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.651078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:49.651916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709effc6-4963-4488-aacb-532b2066957a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.658618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.659226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.659507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.659780 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.660511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.662365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.680402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1040/2091] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:49.685300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.714511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc44-407b-4a5b-8fa9-6ee71a98d281 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.721521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.722535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.722886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.723259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.724010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.725738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.742842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:49.757386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1041/2092] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:49.757386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.775047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2bc0-9b86-4a30-8909-bc9ebd819771 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.776182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8b36d-7f13-40f2-9d2b-cecd48086e82 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.780165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.780950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.781375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.781792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.788704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:49.790082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.790500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.790898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] PATH_INFO: `/v3/projects/b8c4d5cad5e0478e922892521727181c/users/af52b762d8774cc5b208a72c0c0119e6/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.792376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.794750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.813972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1052/2093] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:49.819438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c4d5cad5e0478e922892521727181c, user_id=af52b762d8774cc5b208a72c0c0119e6, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:49.823893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f766e-5708-4197-aee3-b154eb616e5b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:49.852802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:49.871012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1042/2094] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:49 2022] PUT /identity/v3/projects/b8c4d5cad5e0478e922892521727181c/users/af52b762d8774cc5b208a72c0c0119e6/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:49.873961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:49.874284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:49.874563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:49.883358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f31b1-43bd-4df1-891c-499d5ff52321 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:49.932917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] MFA Rules not processed for user `af52b762d8774cc5b208a72c0c0119e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:49.934456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:50.007133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:50.013027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:50.013843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:50.014446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:50.014824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] PATH_INFO: `/v3/users/b9616a1d9a1f464499a31c9a17fb7400` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:50.016223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9616a1d9a1f464499a31c9a17fb7400)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:50.018873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:50.046336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1043/2095] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:50.070099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:50.072415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:50.096211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9616a1d9a1f464499a31c9a17fb7400'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:50.098124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9616a1d9a1f464499a31c9a17fb7400'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:50.114019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9616a1d9a1f464499a31c9a17fb7400'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:50.152722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9616a1d9a1f464499a31c9a17fb7400'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:50.153691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-83af34e0-db91-44f3-a05a-33f6f3d92168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9616a1d9a1f464499a31c9a17fb7400'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:50.176136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1053/2096] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:49 2022] DELETE /identity/v3/users/b9616a1d9a1f464499a31c9a17fb7400 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:50.181256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:50.182049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:50.182382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:50.203428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f06134-6d75-441e-a976-b41ee7961b24 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:50.215904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:50.217101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:50.304227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:50.305377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:50.305871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:50.306415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:50.309713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:50.333059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:50.361526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1054/2097] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:50.374528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:50.378940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:50.498208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:50.499706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221b1e-17d0-4c39-bd3c-fce26d5afcc1 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:50.530191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1044/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:50.542931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7f12-d7b3-4c7f-b87b-9967de67ed8b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:50.554189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:50.554946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:50.555231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:50.555501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:50.590685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:50.592141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:50.620212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1055/2099] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:51.086628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e83a94-259c-410b-85ae-f23c3b5460e1 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.087724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e83a94-259c-410b-85ae-f23c3b5460e1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.088163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e83a94-259c-410b-85ae-f23c3b5460e1 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.088850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.090359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.091236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1045/2100] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:43:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:43:51.109880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb352-1367-4126-9588-26f12808d176 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.117203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.117911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.118192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.118468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] PATH_INFO: `/v3/projects/7d756a74dad14fe482ebf847a57d14c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.119635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d756a74dad14fe482ebf847a57d14c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.121701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.128799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788d32-15f4-42ed-a674-482dceea8c8d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.129094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788d32-15f4-42ed-a674-482dceea8c8d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.129364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788d32-15f4-42ed-a674-482dceea8c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.155698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3d788d32-15f4-42ed-a674-482dceea8c8d None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:51.158335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3d788d32-15f4-42ed-a674-482dceea8c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.206033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d756a74dad14fe482ebf847a57d14c9', 'request_id': 'req-592c4852-1fac-454a-ab58-85c0a53dca5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.220439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d756a74dad14fe482ebf847a57d14c9', 'request_id': 'req-592c4852-1fac-454a-ab58-85c0a53dca5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.230965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d756a74dad14fe482ebf847a57d14c9', 'request_id': 'req-592c4852-1fac-454a-ab58-85c0a53dca5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.240196 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:51.248685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] The token cache is being invalidate because project 7d756a74dad14fe482ebf847a57d14c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:51.248982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.251514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.253163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1056/2101] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:51 2022] DELETE /identity/v3/projects/7d756a74dad14fe482ebf847a57d14c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:43:51.254773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.256521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.267005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1046/2102] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:51.268615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.268914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.269193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.298474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:51.299878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.349153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4852-1fac-454a-ab58-85c0a53dca5c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.354922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.355624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.356084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.356631 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] PATH_INFO: `/v3/users/c2ade7e02b814dfab184622fbe3c3557` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.357873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ade7e02b814dfab184622fbe3c3557)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.359948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.378113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1047/2103] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:51.378113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.379721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.393601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:51.434117 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ade7e02b814dfab184622fbe3c3557'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.434812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ade7e02b814dfab184622fbe3c3557'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.442590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ade7e02b814dfab184622fbe3c3557'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.456430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795e784-6d25-4000-bb1a-a735e04570f6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.456941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ade7e02b814dfab184622fbe3c3557'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.457841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f0dc1a8f-e3a6-49b9-8558-60e35b186873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ade7e02b814dfab184622fbe3c3557'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.463043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.463716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.464072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.464353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.466146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.473386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1057/2104] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:51 2022] DELETE /identity/v3/users/c2ade7e02b814dfab184622fbe3c3557 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:51.475512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.475969 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.476254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.482356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.486373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.500790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:51.501582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1048/2105] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:51.502471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.584869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1058/2106] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:51.586039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.596357 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50af55e-b40a-4624-8854-e13e7348ba8c service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.601683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.602432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.602952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.603278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.603880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:51.604181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.605768 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.618606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1049/2107] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:51.622913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.633873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54a8b-bc31-42a4-a16b-ab384649deea None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.641350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.643860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.646158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.646560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.648274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.650684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.674206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.676494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:51.687481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1059/2108] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:51.690590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.711817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57fe4-1dcb-4338-a44e-12d1a6e12151 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.784291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f4f4-d545-4065-a75c-21bba8dafc78 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.792199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.794343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.795171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.795721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.796920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.800699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.803290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.804011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.804365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.804712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] PATH_INFO: `/v3/projects/d935fc5cbb2c4e0287afa743a9bfc2ca` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.806019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d935fc5cbb2c4e0287afa743a9bfc2ca)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.808146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.823002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:51.833219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1060/2109] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:51.846048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.862450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c4b61-a9de-4437-baa8-4db852fdae91 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.868141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:51.869007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.869293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.870153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.871133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:51.872765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:51.879690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:51.889063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd935fc5cbb2c4e0287afa743a9bfc2ca', 'request_id': 'req-572f4cf2-614d-4f66-962c-b73ac0d0ea32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.889764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1061/2110] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:51.891311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:51.900023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd935fc5cbb2c4e0287afa743a9bfc2ca', 'request_id': 'req-572f4cf2-614d-4f66-962c-b73ac0d0ea32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.910589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd935fc5cbb2c4e0287afa743a9bfc2ca', 'request_id': 'req-572f4cf2-614d-4f66-962c-b73ac0d0ea32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.913790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4421c-8b98-4c86-8cfc-e7a702c34516 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:51.926189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] The token cache is being invalidate because project d935fc5cbb2c4e0287afa743a9bfc2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:51.926675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.927632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-572f4cf2-614d-4f66-962c-b73ac0d0ea32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:51.930388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1050/2111] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:51 2022] DELETE /identity/v3/projects/d935fc5cbb2c4e0287afa743a9bfc2ca => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:51.934971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb64-2f51-4108-be50-9bb1d2e9134a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:51.935375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb64-2f51-4108-be50-9bb1d2e9134a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:51.935821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb64-2f51-4108-be50-9bb1d2e9134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:51.974685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-589feb64-2f51-4108-be50-9bb1d2e9134a None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:51.976709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-589feb64-2f51-4108-be50-9bb1d2e9134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.012845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.013480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.013768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.014089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.014738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.016387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.028134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1062/2112] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:52.032851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.036840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.050613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160723-3787-4d8b-b889-f36174dd8dcd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.056387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.057329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.057712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.058215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1051/2113] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:52.058896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] PATH_INFO: `/v3/projects/fb6e1e392fb847638254426381274598/users/39d3b5067c834920931f6849ef960a64/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.066947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.067236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.067517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.085629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6e1e392fb847638254426381274598, user_id=39d3b5067c834920931f6849ef960a64, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.088843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef820e4e-57a9-4358-a692-b548c2e02adf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.090688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:52.091921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.108594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1052/2114] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:52.112606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.115748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1063/2115] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:52 2022] PUT /identity/v3/projects/fb6e1e392fb847638254426381274598/users/39d3b5067c834920931f6849ef960a64/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:52.125876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a6d4d-0554-4a99-a85d-08e3f6a54f16 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.127643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.128139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.128591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.161283 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] MFA Rules not processed for user `39d3b5067c834920931f6849ef960a64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:52.162559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.211673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.211673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.211673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.212116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.212958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:52.213336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.215419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.241779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1053/2116] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:52.244276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.258267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f303af-f7cf-45d1-a5fa-811748e87f8a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.264286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.264966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.265349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.265825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.266555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.268641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.291361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1064/2117] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:52.308448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.310085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.335610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1054/2118] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:52 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:52.336906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.347833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:52.441811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:52.454598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb1caa-ef93-4450-8ed8-d1070b51fd8b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.455232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600606-fedf-42ff-9e48-08c358c59dd6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.471837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.472652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.473286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.474015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.474734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.476930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.503200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1055/2119] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:52 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:52.507553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.519908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff410534-d121-40d2-ae77-0a11575d43ac admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.537499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.538363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.538648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.539191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.539811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.541462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.541866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.542146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.542598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.542877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.557408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1056/2120] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:43:52.558354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.572378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add665-15d1-4034-be4a-ff30aad90f7f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.577317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.578181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.579925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.579925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.579925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.581265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.594230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1057/2121] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:52.598338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.609408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db76e83-52ae-4d5e-9166-38e9d82e1f0e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.611846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.614208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93271f4-d5f2-4b19-be7c-7a7656a2f5c3 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.614702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.615456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.616378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.616769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] PATH_INFO: `/v3/projects/c2355d99a24b4f9f961bdd309079d21d/users/7cf7b00dc3c84466a89ecfcd76bd1a4e/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.627379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1065/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:43:52.633329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2355d99a24b4f9f961bdd309079d21d, user_id=7cf7b00dc3c84466a89ecfcd76bd1a4e, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.636237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.669288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1058/2123] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:52 2022] PUT /identity/v3/projects/c2355d99a24b4f9f961bdd309079d21d/users/7cf7b00dc3c84466a89ecfcd76bd1a4e/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:52.674624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.675101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.675532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.704111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:52.705699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.790764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1066/2124] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:52.801115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:52.804018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:52.881722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f324-5cef-4529-bcbe-f4ac3bc1bda4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:52.885694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:52.886266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:52.890244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:52.890547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:52.900674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:52.902209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d03d1-a503-4bd4-a1e4-709ddad1f365 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:52.914154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1059/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:53.564388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:53.565881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:53.579415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0fe0-45c0-406a-993b-6f4d15dbe817 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:53.587703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:53.588770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:53.589222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:53.590174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] PATH_INFO: `/v3/users/af52b762d8774cc5b208a72c0c0119e6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:53.591943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af52b762d8774cc5b208a72c0c0119e6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:53.597682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:53.699049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af52b762d8774cc5b208a72c0c0119e6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:53.704348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af52b762d8774cc5b208a72c0c0119e6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:53.707373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:53.725498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af52b762d8774cc5b208a72c0c0119e6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:53.743723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af52b762d8774cc5b208a72c0c0119e6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:53.744700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af52b762d8774cc5b208a72c0c0119e6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:53.767157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1067/2126] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:53 2022] DELETE /identity/v3/users/af52b762d8774cc5b208a72c0c0119e6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:53.771697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:53.772257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:53.772475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:53.795979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:53.797017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:53.856224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:53.877447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:53.888361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:53.889974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:53.985654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015ea9-d995-4aaa-8a9f-11b5f1689dc7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:53.991475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:53.992857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:53.993453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:53.993899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.012609 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:54.014563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221a6f-3529-47b8-9304-76fd900dc6d0 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:54.031520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1068/2128] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:54.557805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:54.559300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:54.579897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef265388-84e4-49e7-91f3-db40e398af9e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:54.586791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:54.587560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:54.587963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:54.588367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] PATH_INFO: `/v3/projects/b8c4d5cad5e0478e922892521727181c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.589652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c4d5cad5e0478e922892521727181c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:54.591802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:54.648647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c4d5cad5e0478e922892521727181c', 'request_id': 'req-114f860d-7c04-4b6b-8cde-870b92344200'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:54.665684 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c4d5cad5e0478e922892521727181c', 'request_id': 'req-114f860d-7c04-4b6b-8cde-870b92344200'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:54.675208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c4d5cad5e0478e922892521727181c', 'request_id': 'req-114f860d-7c04-4b6b-8cde-870b92344200'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:54.686950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] The token cache is being invalidate because project b8c4d5cad5e0478e922892521727181c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:54.687638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:54.688966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-114f860d-7c04-4b6b-8cde-870b92344200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:54.691604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1061/2129] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:54 2022] DELETE /identity/v3/projects/b8c4d5cad5e0478e922892521727181c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:54.697857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:54.698175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:54.698454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.723124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:54.724520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:54.821806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1069/2130] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:54.830762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:54.831647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:54.832079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.862885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:54.864189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:54.872612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1062/2131] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:54.877236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:54.891488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab345ff-66dc-4af3-bdf9-83ce15db0d64 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:54.900713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:54.901334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:54.901615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:54.901914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.902601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:54.902911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:54.904716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:54.922951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1070/2132] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:43:54.927278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:54.938299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec88ac-36f7-420f-82c0-4be4792116b2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:54.944573 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:54.945318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:54.945669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:54.946080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:54.946815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:54.950223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.016654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1063/2133] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:54 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:55.019982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:55.041259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356cb2-1e0e-4d21-a5d9-93a0dc5d4468 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:55.136131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:55.145778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:55.146651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.147685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.148297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.161502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:55.167729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.227889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1071/2134] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:55 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:55.232002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:55.248448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192aed-ed5f-4b3c-9e78-dc2793b25c3c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:55.259940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:55.272569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.273602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.274986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.280444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:55.283664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.306442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1064/2135] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:55.306667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:55.316672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244a220-867e-4727-a66e-e259c728dbcf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:55.324070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:55.324912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.325215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.325577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.326429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:55.329915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80807da5-e5f7-4fab-91d4-f71cd5e7da07 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.351881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1072/2136] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:55.353158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:55.384421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a54a6-a4e2-4552-9b69-e92147861e43 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:55.389289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:55.390079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.390549 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.390822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] PATH_INFO: `/v3/projects/f44b9904baf24a3d922a962a06bd8201/users/33a2c9415b554ec791301c041d10ec82/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.407032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44b9904baf24a3d922a962a06bd8201, user_id=33a2c9415b554ec791301c041d10ec82, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:55.409906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.428618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1065/2137] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:55 2022] PUT /identity/v3/projects/f44b9904baf24a3d922a962a06bd8201/users/33a2c9415b554ec791301c041d10ec82/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:55.443613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.444666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.445165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.478220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] MFA Rules not processed for user `33a2c9415b554ec791301c041d10ec82`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:55.479362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:55.544571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1073/2138] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:55.557621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:55.559692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:55.636729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c96dc-bb9c-40a6-ae0e-b30f628118b2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:55.640933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:55.641610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:55.642038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:55.642222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:55.653303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:55.654935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6517-774f-4470-9f18-bcf6f54f77f2 service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:55.667553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1066/2139] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:56.418643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:56.421011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:56.575848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ace5c-68ec-49f9-a59f-97a0ab7d2d2d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:56.591873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:56.592892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:56.593359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:56.594111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] PATH_INFO: `/v3/users/ebcc353410b54ffd926f869e5cafc7dd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:56.596295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcc353410b54ffd926f869e5cafc7dd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:56.598515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:56.715214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcc353410b54ffd926f869e5cafc7dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:56.715990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcc353410b54ffd926f869e5cafc7dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:56.732941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcc353410b54ffd926f869e5cafc7dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:56.750688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:56.779899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcc353410b54ffd926f869e5cafc7dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:56.780749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcc353410b54ffd926f869e5cafc7dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:56.828651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1074/2140] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:43:56 2022] DELETE /identity/v3/users/ebcc353410b54ffd926f869e5cafc7dd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:56.833505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:56.836568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:56.837164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:56.879510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:56.882554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:56.892529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:56.966536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1067/2141] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:56.978079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:56.979914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:57.079018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841174ff-8fb5-47a8-8b38-e49699067355 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:57.086140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:57.087485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.087771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.088049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.103635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:57.107846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecab1c-b452-4f08-8131-b919ba9aa1c0 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:57.148084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1075/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:57.505985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:57.507271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:57.520026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f06a0-979d-408f-9e26-ac02c98420c8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:57.526049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:57.526613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.526971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.527154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] PATH_INFO: `/v3/projects/ce4a624198974147b832f7e67ca5612d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.528346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4a624198974147b832f7e67ca5612d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:57.530364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:57.605972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4a624198974147b832f7e67ca5612d', 'request_id': 'req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:57.615711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4a624198974147b832f7e67ca5612d', 'request_id': 'req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:57.626754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4a624198974147b832f7e67ca5612d', 'request_id': 'req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:57.645860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] The token cache is being invalidate because project ce4a624198974147b832f7e67ca5612d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:43:57.645860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:57.647288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4abe4a-7e9d-466d-a0ca-fe085b49fc54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:43:57.649154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1068/2143] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:43:57 2022] DELETE /identity/v3/projects/ce4a624198974147b832f7e67ca5612d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:57.654627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.655108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.655108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.678174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:57.678174 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:57.754067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1076/2144] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:57.762634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.769511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.770201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.822898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:57.824179 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:57.835191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1069/2145] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:57.840158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:57.858584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4e7db-9ae6-49d0-8346-e09fc9651bb7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:57.864156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:57.864962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.865239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.865510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.867039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:43:57.867344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:57.870418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:57.899789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1077/2146] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:43:57.904361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:57.924401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b4fd3-28b5-44e0-8447-578275e1ea69 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:57.933471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:57.934896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:57.934896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:57.935164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:57.935915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:57.938674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.007950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1070/2147] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:43:57 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:43:58.011831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.030041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98307566-895e-4e2b-9cf7-ae0dbd72e11f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.122798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.122798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.122798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.122798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.123256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.126772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703c976-085d-4cd4-9aaf-2e5a6814f78b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.160423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1078/2148] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:43:58 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:43:58.164740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.179367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff12fcf-d55d-4362-a686-0ee33dbd64e7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.185293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.186143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.186892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.187284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.188863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.191985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.217979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1071/2149] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:58.218428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.218800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.219198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.220404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.233318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:58.235449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685849c-f815-4f05-9ff6-6d57a4915a17 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.242602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.243830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.244364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.244883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.246045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.248312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.266145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1072/2150] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:43:58.267291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.283932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0928729-68a0-4e17-83e7-0998b4cb4098 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.297373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.297979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.299932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.300226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] PATH_INFO: `/v3/projects/5b63022c1d844855b1b7cbdf09efa0b6/users/f55f72d0874d4f578c3ae5721aeae429/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.316794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] MFA Rules not processed for user `7cf7b00dc3c84466a89ecfcd76bd1a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:58.318376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:58.336661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b63022c1d844855b1b7cbdf09efa0b6, user_id=f55f72d0874d4f578c3ae5721aeae429, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.340217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf07a8-1ae5-47f8-b6c8-316990c94ae2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.382053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1073/2151] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:43:58 2022] PUT /identity/v3/projects/5b63022c1d844855b1b7cbdf09efa0b6/users/f55f72d0874d4f578c3ae5721aeae429/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:43:58.387445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.388128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.388874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.433262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:43:58.434734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:58.495165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:58.507541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1079/2152] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:43:58.523345 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.529316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:58.574329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1074/2153] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:43:58.582368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:43:58.584171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:43:58.625106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70823964-85db-4139-8ef1-fb684c26da6b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.665859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bf30e-08b2-4731-aace-44eaac8612bc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:43:58.671675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.672475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.672913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.673395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.691911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.693444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419ce1d-861f-4ec7-9a0b-73eec4c6c5f5 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.706476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1075/2154] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:43:58.707861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:43:58.708473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:43:58.708752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:43:58.709041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:43:58.780956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:43:58.823607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:43:58.825355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1cb78-3223-4884-9b34-df05776099be service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:43:58.839185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1080/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:43:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:00.817441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:00.817985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:00.818069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:00.862088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] MFA Rules not processed for user `7cf7b00dc3c84466a89ecfcd76bd1a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:00.864360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:00.875915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1076/2156] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:04.559790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:04.560260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:04.560353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:04.599929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] MFA Rules not processed for user `f55f72d0874d4f578c3ae5721aeae429`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:04.601935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:04.692286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1081/2157] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:04.697775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:04.710259 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161ff4-bee9-420c-8521-3dfdd5c8fecc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:04.716326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:04.717438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:04.718104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:04.718312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:04.719034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:04.720976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:04.757371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:04.763562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1077/2158] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:04 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:04.770643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60552ed3-8272-4f1c-a660-8837d236a514 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:04.864546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:04.865176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:04.865458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:04.865773 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:04.866854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:04.869015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:04.908902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1082/2159] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:04 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:04.913083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:04.926501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a2328-a3a9-4635-b522-aac3482b0d52 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:04.932378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:04.933198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:04.933703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:04.933963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:04.935318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:04.936452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:04.952830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1078/2160] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:04.954104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:04.965021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629a399-9dd5-408e-994b-9f6d3f13e159 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:04.969661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:04.970342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:04.970623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:04.970892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] PATH_INFO: `/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111/users/bf2a63ec5c8b4d4faed321f65634cc21/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:04.988775 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f3b520440c4ed1ba7b5f4e49f3c111, user_id=bf2a63ec5c8b4d4faed321f65634cc21, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:04.992539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:05.020534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1083/2161] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:04 2022] PUT /identity/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111/users/bf2a63ec5c8b4d4faed321f65634cc21/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:05.025359 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:05.046416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32f4d-bf35-43d3-a15b-9b5a96b032f1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:05.142771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:05.143396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:05.143681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:05.143953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:05.144613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:05.146401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b80a0-8c68-44f5-b9d6-ba8beb649a81 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:05.158910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1079/2162] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:05.163135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:05.180113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37e290-7c95-46a3-ad7d-be63fde1bff4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:05.185398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:05.186139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:05.186428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:05.186712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] PATH_INFO: `/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111/users/bf2a63ec5c8b4d4faed321f65634cc21/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:05.188643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f3b520440c4ed1ba7b5f4e49f3c111, user_id=bf2a63ec5c8b4d4faed321f65634cc21, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:05.191335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8976a6c-e909-466f-9c5b-ca91b3b8f7cd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:05.204074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1084/2163] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:05 2022] PUT /identity/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111/users/bf2a63ec5c8b4d4faed321f65634cc21/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:06.914485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:06.915418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:06.915887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:06.919329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1080/2164] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:44:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:44:06.957587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:06.958572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:06.959092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:06.996061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] MFA Rules not processed for user `e477d29670604652952616a8600d11cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:06.997336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:07.008162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:07.111791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1085/2165] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:44:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:07.129392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:07.132046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:07.167465 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450825a-e6a0-4080-8f85-26b56492d54d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:07.188523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:07.194951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:07.196508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:07.196994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:07.221107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:07.222878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:07.262326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1081/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:07.856115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:07.858111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:07.993138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d58cd-131a-494c-8e32-eb139d75ec33 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:08.007054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:08.007796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:08.008250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:08.013284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] PATH_INFO: `/v3/users/8b5c6f934d8f42e987442d16a01313c6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:08.015223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5c6f934d8f42e987442d16a01313c6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:08.017617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:08.111971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5c6f934d8f42e987442d16a01313c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.112395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5c6f934d8f42e987442d16a01313c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.128473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5c6f934d8f42e987442d16a01313c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.154944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5c6f934d8f42e987442d16a01313c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.155708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5c6f934d8f42e987442d16a01313c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.191304 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1086/2167] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:07 2022] DELETE /identity/v3/users/8b5c6f934d8f42e987442d16a01313c6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:08.570150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:08.586789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366b651-a9bd-4b58-b7e5-5cc950faaf41 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:08.604317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:08.741594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:08.742481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:08.742891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:08.743239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] PATH_INFO: `/v3/projects/35678db5253446859f6c7e798f09c10b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:08.745481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35678db5253446859f6c7e798f09c10b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:08.748250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:08.829388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35678db5253446859f6c7e798f09c10b', 'request_id': 'req-2833c2b4-f331-4d0c-b66c-834611beafa0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.846078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35678db5253446859f6c7e798f09c10b', 'request_id': 'req-2833c2b4-f331-4d0c-b66c-834611beafa0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.865733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35678db5253446859f6c7e798f09c10b', 'request_id': 'req-2833c2b4-f331-4d0c-b66c-834611beafa0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.879171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] The token cache is being invalidate because project 35678db5253446859f6c7e798f09c10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:08.879542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.880288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:08.882446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1082/2168] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:08 2022] DELETE /identity/v3/projects/35678db5253446859f6c7e798f09c10b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:08.887397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:08.889265 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:08.905331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04503f-ddb6-48d2-92a0-2e93d9776843 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:08.948352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:08.997876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:08.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:08.998803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:08.999017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] PATH_INFO: `/v3/users/9d493f6cad23465d8e850007e1e5f1bc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:09.000247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d493f6cad23465d8e850007e1e5f1bc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:09.002408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:09.098848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d493f6cad23465d8e850007e1e5f1bc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.101139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d493f6cad23465d8e850007e1e5f1bc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.119720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d493f6cad23465d8e850007e1e5f1bc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.137733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d493f6cad23465d8e850007e1e5f1bc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.138769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7d8eb868-a215-4796-9739-d2ab5212d719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d493f6cad23465d8e850007e1e5f1bc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.172020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1087/2169] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:08 2022] DELETE /identity/v3/users/9d493f6cad23465d8e850007e1e5f1bc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:09.430094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:09.434020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:09.474715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c2b4-f331-4d0c-b66c-834611beafa0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:09.647490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:09.648147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:09.648429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:09.648704 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] PATH_INFO: `/v3/projects/41474f9f795b463399398ac42840aa21` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:09.651523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41474f9f795b463399398ac42840aa21)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:09.653472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:09.757737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:09.771637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41474f9f795b463399398ac42840aa21', 'request_id': 'req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.794188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41474f9f795b463399398ac42840aa21', 'request_id': 'req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.820707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41474f9f795b463399398ac42840aa21', 'request_id': 'req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.877506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] The token cache is being invalidate because project 41474f9f795b463399398ac42840aa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:09.877802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.879450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ef2eb62c-27f7-4737-8d8d-a1cdad4bdc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:09.883107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1083/2170] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:09 2022] DELETE /identity/v3/projects/41474f9f795b463399398ac42840aa21 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:09.888492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:09.889187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:09.889699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:09.940256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:09.941822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:10.023812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1088/2171] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:10.032867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.033475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.033671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.078887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:10.093904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:10.104494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1084/2172] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:10.108511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.120237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5989d2-6f47-43f9-8367-35d33812fdc0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.125395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.127003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.127540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.127897 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.128862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:10.129438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.131124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.169689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1089/2173] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:44:10.171413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.182507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7fdea-a61d-4b09-b5b5-0b99c1c6b2ba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.192186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.193067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.193406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.194303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.195023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.197234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.268821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1085/2174] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:10 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:10.270087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.284547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30990-6cbd-46d2-ad47-926814109ce7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.382458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:10.431868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.432729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.435702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.436108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.436891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.439197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.469143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1090/2175] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:10 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:10.473735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.486691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa36b-8961-4489-973a-076c88100109 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.502088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.503224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.503797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.504525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.506824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.509552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.536008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1086/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:10.540324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.557836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16490e-a8d1-4f52-9910-3d37d6f118c7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.573738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.574183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.574466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.574740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.575391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.585082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2766af-b5d7-46a1-b164-28ec7a22bb45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.617455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1091/2177] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:10.622081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:10.639725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c23078-ec04-4a5b-a00a-882f97760109 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:10.658477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:10.659228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.659432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.659888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] PATH_INFO: `/v3/projects/2e9a449a498f4d80a300a0e52e589f11/users/f030e1c309a84dba86a2dee97efd5fae/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.693751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9a449a498f4d80a300a0e52e589f11, user_id=f030e1c309a84dba86a2dee97efd5fae, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:10.700069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:10.730303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1087/2178] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:10 2022] PUT /identity/v3/projects/2e9a449a498f4d80a300a0e52e589f11/users/f030e1c309a84dba86a2dee97efd5fae/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:10.736299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:10.736299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:10.736299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:10.794182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] MFA Rules not processed for user `f030e1c309a84dba86a2dee97efd5fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:10.795551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:10.932879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1092/2179] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:10.936995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.063272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5b7b6-404b-434b-9437-5938eaf8a8ba admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.068262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.069762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.070139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.070585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.071283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.073417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.115047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1088/2180] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:10 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:11.119841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.142602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94d13b-3844-408f-90db-ca46420449ea None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.229852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.230814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.231275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.231713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.232518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.234708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.269602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1093/2181] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:11 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:44:11.273669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.300664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b173-9800-47a3-b152-f5fa5807672f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.307886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.308733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.309023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.309306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.310428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.312563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.335929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1089/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:11.337229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.348576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75a04-d332-4456-a37b-4bb490ea0e11 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.355145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.355988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.356393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.356507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] PATH_INFO: `/v3/projects/7cfb40f8afa342e4b936d161bc0c866f/users/bf84f18fb2364d93aa1ab1397d50c5f0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.375485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfb40f8afa342e4b936d161bc0c866f, user_id=bf84f18fb2364d93aa1ab1397d50c5f0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.378571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.402024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1094/2183] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:11 2022] PUT /identity/v3/projects/7cfb40f8afa342e4b936d161bc0c866f/users/bf84f18fb2364d93aa1ab1397d50c5f0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:11.404080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.425100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed370cf-7e9d-41b5-a96b-05e34c22417b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.556494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:11.594002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.594900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.595255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.596204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.597379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.599188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09bb6e-3fba-4e54-b064-635062acb4ef admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.629523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.630304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1090/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:44:11.640389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:11.646767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacda6fa-29be-4e79-9d9a-1cdb9d51a4c0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:11.655626 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:11.656646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.657882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.658756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] PATH_INFO: `/v3/projects/7cfb40f8afa342e4b936d161bc0c866f/users/bf84f18fb2364d93aa1ab1397d50c5f0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.661200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfb40f8afa342e4b936d161bc0c866f, user_id=bf84f18fb2364d93aa1ab1397d50c5f0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:11.666116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:11.687986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1095/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:11 2022] PUT /identity/v3/projects/7cfb40f8afa342e4b936d161bc0c866f/users/bf84f18fb2364d93aa1ab1397d50c5f0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:11.701536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398099-b492-4f42-8a9b-2c8af679fef1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:11.704782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398099-b492-4f42-8a9b-2c8af679fef1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:11.705531 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed398099-b492-4f42-8a9b-2c8af679fef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:11.743688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ed398099-b492-4f42-8a9b-2c8af679fef1 None None] MFA Rules not processed for user `bf84f18fb2364d93aa1ab1397d50c5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:11.745141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ed398099-b492-4f42-8a9b-2c8af679fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:11.856204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1091/2186] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:11.865144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:11.875559 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:11.998745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052c13-d77a-44f5-8bfb-15e85706f4f0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:12.017254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:12.018152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:12.018512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:12.019015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:12.123863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:12.125115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8d14-bfea-400b-915f-028156f81631 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:12.125349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:12.125468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8d14-bfea-400b-915f-028156f81631 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:12.125671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8d14-bfea-400b-915f-028156f81631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:12.143137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1096/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:12.181827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b7ae8d14-bfea-400b-915f-028156f81631 None None] MFA Rules not processed for user `bf2a63ec5c8b4d4faed321f65634cc21`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:12.183662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b7ae8d14-bfea-400b-915f-028156f81631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:12.381449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1092/2188] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:12.392011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:12.395895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:12.516708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6e2c-c4e3-45b9-940b-5c16d924dc8d service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:12.521555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:12.523031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:12.523031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:12.523243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:12.525629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:12.651346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:12.652726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:12.658332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:12.667169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1097/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:12.956814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:12.957349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:12.957493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:12.992223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:13.008609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:13.061016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:13.105827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1093/2190] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:44:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:13.159650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:13.161091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:13.252418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109210c-a20f-48ef-87f6-d53f80cb1f41 service glance] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:13.258229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:13.258861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:13.259140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:13.259418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:13.276794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:13.282592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6508d9-bf08-4143-9d2a-ec00296624a7 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:13.288892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1098/2191] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:44:16.974231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:16.976528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:17.106119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd645fb-5ca4-42d1-82c3-b3e4f9f97e52 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:17.114147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:17.116336 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:17.116770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:17.122418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] PATH_INFO: `/v3/users/39d3b5067c834920931f6849ef960a64` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:17.124010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d3b5067c834920931f6849ef960a64)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:17.126142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:17.256839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d3b5067c834920931f6849ef960a64'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:17.258413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d3b5067c834920931f6849ef960a64'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:17.283960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d3b5067c834920931f6849ef960a64'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:17.379064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d3b5067c834920931f6849ef960a64'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:17.380038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d3b5067c834920931f6849ef960a64'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:17.417586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1094/2192] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:16 2022] DELETE /identity/v3/users/39d3b5067c834920931f6849ef960a64 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:17.418074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:17.418914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:17.419336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:17.462930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:17.464738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:17.591825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1099/2193] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:17.602794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:17.604748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:17.755663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:17.758097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:17.807808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993b95-27de-46a5-a13a-a862d5163426 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:17.840957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:17.841997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:17.842432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:17.842858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:17.898475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:17.900439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:17.946292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1095/2194] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:17.968831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702fa29-cfa0-4421-b895-18f30c7b63c2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:17.973500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:17.974221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:17.974511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:17.974782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:17.977082 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:18.084190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:18.114583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:18.117481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4b87-af22-4ffc-a6ce-5af0d20d4184 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:18.153970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1100/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:44:19.137412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:19.139335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:19.176621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ec48d-88f8-4616-8989-2f58597f3c12 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:19.187309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:19.189172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.190993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.191621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] PATH_INFO: `/v3/projects/fb6e1e392fb847638254426381274598` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.195458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6e1e392fb847638254426381274598)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:19.200395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:19.213909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:19.285511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6e1e392fb847638254426381274598', 'request_id': 'req-22934919-8e21-4b5d-9a00-6c83053f4e81'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:19.302502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6e1e392fb847638254426381274598', 'request_id': 'req-22934919-8e21-4b5d-9a00-6c83053f4e81'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:19.316063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6e1e392fb847638254426381274598', 'request_id': 'req-22934919-8e21-4b5d-9a00-6c83053f4e81'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:19.330726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] The token cache is being invalidate because project fb6e1e392fb847638254426381274598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:19.331031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:19.331711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22934919-8e21-4b5d-9a00-6c83053f4e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:19.334353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1096/2196] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:19 2022] DELETE /identity/v3/projects/fb6e1e392fb847638254426381274598 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:19.338449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.338971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.338971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.361542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:19.364755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:19.464907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1101/2197] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:19.473666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.473989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.474273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.502246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:19.503852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:19.515838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1097/2198] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:19.520299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:19.534179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86468b4-6a28-4f0d-b356-d0aeee651f00 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:19.544136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:19.544702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.544988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.545254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.546060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:19.546371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:19.548078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:19.563556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1102/2199] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:44:19.567953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:19.584662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14266be-5611-408f-b0f0-9191e4e51290 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:19.594608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:19.595534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.596118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.596616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.597501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:19.599733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:19.652084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1098/2200] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:19 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:19.653371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:19.667614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356328c-275c-4f27-8827-17dbccdaa078 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:19.844162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:19.844890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.845240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.845575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.846478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:19.848687 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:19.897152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1103/2201] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:19 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:19.918302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:19.940328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a505857-2e7f-40c4-94bf-e6a253f6f3a7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:19.960183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:19.960868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:19.961245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:19.961646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:19.962536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:19.967356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:19.991544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1099/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:19.996908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:20.030409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1f73-93be-42b3-953a-078f64ffd9af admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:20.040441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:20.041186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:20.041571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:20.041968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:20.043339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:20.050075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617c1ac-2b93-49ab-9338-6ea3f3f0feb1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:20.071917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1104/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:20.073968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:20.096312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d7aa-57ce-4b8e-be7b-0cfbe9f52e01 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:20.107358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:20.108051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:20.108335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:20.108635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] PATH_INFO: `/v3/projects/1a046aab888e4cea86ba7371a6ee32b4/users/e390463bd7da42819946547393decb77/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:20.171103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a046aab888e4cea86ba7371a6ee32b4, user_id=e390463bd7da42819946547393decb77, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:20.173814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:20.203864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1100/2204] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:20 2022] PUT /identity/v3/projects/1a046aab888e4cea86ba7371a6ee32b4/users/e390463bd7da42819946547393decb77/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:20.219938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:20.220188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:20.220470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:20.315459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] MFA Rules not processed for user `e390463bd7da42819946547393decb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:20.316771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:20.448745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:20.560511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1105/2205] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:20.577439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:20.579458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:20.681539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe854451-5d6d-4ca5-9c3b-c6d5f79ecfb4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:20.696719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:20.698256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:20.698839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:20.699320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:20.721848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:20.723428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f26502-cf70-428c-b8c3-362aec7776db service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:20.736589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1101/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:24.220741 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:24.222731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:24.303812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3300c22-6e6d-494d-9389-16e958f4de26 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:24.309260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:24.310181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:24.310453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:24.310844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] PATH_INFO: `/v3/users/f030e1c309a84dba86a2dee97efd5fae` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:24.312120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f030e1c309a84dba86a2dee97efd5fae)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:24.314423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:24.395192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f030e1c309a84dba86a2dee97efd5fae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:24.396064 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f030e1c309a84dba86a2dee97efd5fae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:24.420173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f030e1c309a84dba86a2dee97efd5fae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:24.437414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f030e1c309a84dba86a2dee97efd5fae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:24.438910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f030e1c309a84dba86a2dee97efd5fae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:24.460777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1106/2207] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:24 2022] DELETE /identity/v3/users/f030e1c309a84dba86a2dee97efd5fae => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:24.465688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:24.466658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:24.467143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:24.504023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:24.505326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:24.546063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:24.607442 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1102/2208] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:24.634942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:24.648153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:24.733679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000e72-e971-4727-8ed6-bd6a84268899 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:24.750343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:24.751356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:24.751677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:24.752247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:24.767825 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:24.770482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:24.777094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:24.789344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1107/2209] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:25.431037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:25.432613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:25.446334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1af991-12ce-47ca-8d1f-d03a868aeb5b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:25.454624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:25.455709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:25.456183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:25.456658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] PATH_INFO: `/v3/projects/2e9a449a498f4d80a300a0e52e589f11` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:25.458026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9a449a498f4d80a300a0e52e589f11)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:25.460180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:25.542952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9a449a498f4d80a300a0e52e589f11', 'request_id': 'req-07eca929-01b9-4e64-905c-907152ec667f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.553528 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9a449a498f4d80a300a0e52e589f11', 'request_id': 'req-07eca929-01b9-4e64-905c-907152ec667f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.576754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9a449a498f4d80a300a0e52e589f11', 'request_id': 'req-07eca929-01b9-4e64-905c-907152ec667f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.607170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] The token cache is being invalidate because project 2e9a449a498f4d80a300a0e52e589f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:25.610929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.611891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.620032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1103/2210] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:25 2022] DELETE /identity/v3/projects/2e9a449a498f4d80a300a0e52e589f11 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:25.621493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:25.637370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890c9d-b559-4260-934e-446893b0db45 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:25.776713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:25.777812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:25.778352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:25.778858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] PATH_INFO: `/v3/users/bf84f18fb2364d93aa1ab1397d50c5f0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:25.784642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf84f18fb2364d93aa1ab1397d50c5f0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:25.787208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:25.908693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf84f18fb2364d93aa1ab1397d50c5f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.918494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf84f18fb2364d93aa1ab1397d50c5f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.927754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf84f18fb2364d93aa1ab1397d50c5f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.962647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf84f18fb2364d93aa1ab1397d50c5f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:25.966128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-08de4785-1cde-41b8-ad1c-7f877cfc41ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf84f18fb2364d93aa1ab1397d50c5f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.006957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1108/2211] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:25 2022] DELETE /identity/v3/users/bf84f18fb2364d93aa1ab1397d50c5f0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:26.580010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:26.582103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:26.632793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca929-01b9-4e64-905c-907152ec667f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:26.673102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa041-a11a-4c70-807c-accaf233848f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:26.674398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa041-a11a-4c70-807c-accaf233848f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:26.674860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fa041-a11a-4c70-807c-accaf233848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:26.717182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9c2fa041-a11a-4c70-807c-accaf233848f None None] MFA Rules not processed for user `06577b267fec462c87bfff97abe065de`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:26.718440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c2fa041-a11a-4c70-807c-accaf233848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:26.739916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:26.740547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:26.741061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:26.741496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] PATH_INFO: `/v3/projects/7cfb40f8afa342e4b936d161bc0c866f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:26.742851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfb40f8afa342e4b936d161bc0c866f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:26.744775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:26.796611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1109/2212] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:26.813106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfb40f8afa342e4b936d161bc0c866f', 'request_id': 'req-a186ce49-8537-4994-9e90-a64636d52562'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.824501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfb40f8afa342e4b936d161bc0c866f', 'request_id': 'req-a186ce49-8537-4994-9e90-a64636d52562'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.837587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfb40f8afa342e4b936d161bc0c866f', 'request_id': 'req-a186ce49-8537-4994-9e90-a64636d52562'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.840658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:26.855455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] The token cache is being invalidate because project 7cfb40f8afa342e4b936d161bc0c866f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:26.856194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.857171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a186ce49-8537-4994-9e90-a64636d52562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:26.858858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1104/2213] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:26 2022] DELETE /identity/v3/projects/7cfb40f8afa342e4b936d161bc0c866f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:26.864871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:26.865176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:26.866245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:26.890103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:26.891786 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:26.914853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:26.985968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1110/2214] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:26.994301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:26.994903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:26.995178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.031803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:27.033295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:27.044265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1105/2215] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:27.048364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.065415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3f4e-92e2-4e3b-889d-f0679c63cf50 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.070442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.071054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.071334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.071603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.072390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:27.072695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.074348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.091227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1111/2216] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:44:27.092886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.105891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bb731-2281-4066-a2fe-dab2747b9ffc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.112062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.112854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.113232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.113796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.114658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.116888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.153320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1106/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:27 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:27.157441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.168889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfdb1d-e546-49e7-abbe-421c12866cdc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.260416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.261341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.261782 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.262234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.263061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.265713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.299743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1112/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:27 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:27.300916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.312644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505d51-8947-43d3-b38a-2bc45e5db3d1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.317583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.318341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.318568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.319398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.320047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.321764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.337551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1107/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:27.341070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.366767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0346468-c3bf-4a20-a065-20a85242d590 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.372971 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.373570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.374119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.374381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.375405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.379208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b582-42bf-4317-b4fe-0b5fe8a00f86 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.419914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1113/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:27.421009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.434412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546ce4-1edd-4bbe-8b27-d48f35842d67 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.444655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.445640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.446027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.446373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] PATH_INFO: `/v3/projects/d85d27239c894d18860a4d787b102e29/users/d954c955a93b4e2ebd7f7ab9e9d95e5e/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.494038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85d27239c894d18860a4d787b102e29, user_id=d954c955a93b4e2ebd7f7ab9e9d95e5e, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.497414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.514851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1108/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:27 2022] PUT /identity/v3/projects/d85d27239c894d18860a4d787b102e29/users/d954c955a93b4e2ebd7f7ab9e9d95e5e/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:27.527132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.527513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.527870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.571090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] MFA Rules not processed for user `d954c955a93b4e2ebd7f7ab9e9d95e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:27.572614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:27.673716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1114/2222] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:27.676915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.794722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b32-48b7-4097-a298-c5a40a35930a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.800947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:27.801670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:27.801968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:27.802333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:27.804271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:27.806224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:27.843003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1109/2223] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:27 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:27.847984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:27.859933 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19d0e-f4e6-4138-a2db-1978314eb558 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:27.918506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:28.020981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.022067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.022548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.023016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.023858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.026326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.062871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1115/2224] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:27 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:28.067020 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.109047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193c69-b18e-43a7-b992-20b4785af6cc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.114925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.115695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.116399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.116678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.117340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.121993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.144028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1110/2225] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:28.157172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.168334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348b1e9-9d24-4d1a-991f-b95c4abcda14 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.172996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.173658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.173954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.174233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] PATH_INFO: `/v3/projects/eaf6690e38114ee7afdb23b2aceec48f/users/fa0832b4366a4a16981e3e60bc784ae9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.190299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6690e38114ee7afdb23b2aceec48f, user_id=fa0832b4366a4a16981e3e60bc784ae9, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.192991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.211862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1116/2226] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:28 2022] PUT /identity/v3/projects/eaf6690e38114ee7afdb23b2aceec48f/users/fa0832b4366a4a16981e3e60bc784ae9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:28.215646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.242332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ac32-2bef-4e7a-9710-2d680895f8bb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.328215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.329002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.329380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.329765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.330508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.332312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dffff-0492-471e-a510-a40ad43c6ea4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.333934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:28.349997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1111/2227] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:44:28.353486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.372010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e49c45-61d1-463e-bfeb-46565599c0f5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.394563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.395187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.395529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.395737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] PATH_INFO: `/v3/projects/eaf6690e38114ee7afdb23b2aceec48f/users/fa0832b4366a4a16981e3e60bc784ae9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.398875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6690e38114ee7afdb23b2aceec48f, user_id=fa0832b4366a4a16981e3e60bc784ae9, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.401499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.428978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1117/2228] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:28 2022] PUT /identity/v3/projects/eaf6690e38114ee7afdb23b2aceec48f/users/fa0832b4366a4a16981e3e60bc784ae9/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:28.429655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.429999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.430301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.484557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] MFA Rules not processed for user `fa0832b4366a4a16981e3e60bc784ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:28.486862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.516098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.517829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.620301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1112/2229] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:28.630549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dbc18-65cf-4a34-84fb-bb9307878178 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.635559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.635994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.636600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.636884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.637167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] PATH_INFO: `/v3/users/33a2c9415b554ec791301c041d10ec82` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.638337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a2c9415b554ec791301c041d10ec82)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.639330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.640255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.698927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a2c9415b554ec791301c041d10ec82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:28.700698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a2c9415b554ec791301c041d10ec82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:28.710176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a2c9415b554ec791301c041d10ec82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:28.724223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:28.725589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a2c9415b554ec791301c041d10ec82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:28.726492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-24a2bbc8-923b-4b2b-b4c8-493cbd1eb59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a2c9415b554ec791301c041d10ec82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:28.734141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0460746-4ece-488b-bed3-805e700ce8be None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:28.738674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:28.739401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.739749 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.740127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.742133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.751289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1118/2230] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:28 2022] DELETE /identity/v3/users/33a2c9415b554ec791301c041d10ec82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:28.755584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c8ba-3cda-4527-9916-d2d73aec72aa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:28.755870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c8ba-3cda-4527-9916-d2d73aec72aa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:28.756145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c8ba-3cda-4527-9916-d2d73aec72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:28.781874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4d1c8ba-3cda-4527-9916-d2d73aec72aa None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:28.786666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4d1c8ba-3cda-4527-9916-d2d73aec72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.821356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:28.822948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:28.834033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1113/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:28.887364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1119/2232] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:28.901265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:28.904870 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:28.970538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:29.003817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821495db-790a-499a-ade0-dcf896da3a40 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:29.061325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0746-b0c2-4601-9afe-5831a8afb323 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:29.061622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0746-b0c2-4601-9afe-5831a8afb323 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:29.061926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0746-b0c2-4601-9afe-5831a8afb323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:29.083722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:29.084376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:29.084677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:29.084941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:29.094666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-83fa0746-b0c2-4601-9afe-5831a8afb323 None None] MFA Rules not processed for user `f55f72d0874d4f578c3ae5721aeae429`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:29.095935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-83fa0746-b0c2-4601-9afe-5831a8afb323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:29.098125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:29.101167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:29.130662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1114/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:29.190084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1120/2234] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:29.816434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:29.818607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:29.842089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd925e4-f611-4ff6-8299-c1b07f5efe7f service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:29.848082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:29.849041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:29.849867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:29.850775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] PATH_INFO: `/v3/projects/f44b9904baf24a3d922a962a06bd8201` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:29.853835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44b9904baf24a3d922a962a06bd8201)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:29.867602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:29.945701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44b9904baf24a3d922a962a06bd8201', 'request_id': 'req-1c8eb95c-7505-462b-b996-a1494e2ab22c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:29.955502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44b9904baf24a3d922a962a06bd8201', 'request_id': 'req-1c8eb95c-7505-462b-b996-a1494e2ab22c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:29.962620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44b9904baf24a3d922a962a06bd8201', 'request_id': 'req-1c8eb95c-7505-462b-b996-a1494e2ab22c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:29.976290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] The token cache is being invalidate because project f44b9904baf24a3d922a962a06bd8201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:29.976503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:29.977254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1c8eb95c-7505-462b-b996-a1494e2ab22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:29.979329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1115/2235] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:29 2022] DELETE /identity/v3/projects/f44b9904baf24a3d922a962a06bd8201 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:29.983962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:29.984459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:29.984558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.025098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:30.026428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:30.111987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1121/2236] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:30.121471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.121765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.122094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.145443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:30.146932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:30.160024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1116/2237] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:30.165153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.175517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8506427-adbc-431c-ba59-070717e828a5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.180677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.181238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.181778 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.182434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.182627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:30.182937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.184831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.217427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1122/2238] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:44:30.223110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.234626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11374b32-448b-4a23-bad0-f36c7f460f1b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.239562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.241544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.242170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.242760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.244161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.247655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.313369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1117/2239] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:30 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:44:30.320587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.346332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e30c2-3c45-4053-8986-eccf94207bbc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.370327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:30.430555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.431319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.431610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.446455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.447216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.449205 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.495767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1123/2240] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:30 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:30.496220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.513957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889820-b079-401a-a725-f809e97f4d11 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.523523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.524153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.524547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.524856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.526011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.527850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.542607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1118/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:30.546659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.559860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780223f-20a5-4205-8396-458aaf3b4350 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.565693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.566342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.566622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.566951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.567601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.569353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d72ac2-c068-409f-9314-27ea430a33ea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.581997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1124/2242] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:30.587641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.602747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78ca81-1078-49e3-8a13-f3ad2e3e81f4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.607800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.608475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.608747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.609025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] PATH_INFO: `/v3/projects/091a9c4fa86e48259acf8a874d94ae0d/users/28faffc1c8d744d3a4a57bfa4610342c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.627016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091a9c4fa86e48259acf8a874d94ae0d, user_id=28faffc1c8d744d3a4a57bfa4610342c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:30.630546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:30.652192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1119/2243] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:30 2022] PUT /identity/v3/projects/091a9c4fa86e48259acf8a874d94ae0d/users/28faffc1c8d744d3a4a57bfa4610342c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:30.665443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.665893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.666217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:30.729238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] MFA Rules not processed for user `28faffc1c8d744d3a4a57bfa4610342c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:30.731374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:30.861602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1125/2244] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:30.873893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:30.875707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:30.907591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:30.977671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64a9f-3d89-4a17-900d-44e0fd9088c7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:30.987417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:30.988370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:30.988686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:30.989151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:31.003781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:31.005545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445768-1808-4f53-a1f0-c219c2606eda service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:31.019432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1120/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:31.810644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:31.813486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:32.010827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3ff6b-6713-4bb9-bc2a-914ae9b82c94 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:32.026945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:32.028069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:32.030339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:32.030803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] PATH_INFO: `/v3/users/d954c955a93b4e2ebd7f7ab9e9d95e5e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:32.034491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d954c955a93b4e2ebd7f7ab9e9d95e5e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:32.038384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:32.154991 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:32.198624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd954c955a93b4e2ebd7f7ab9e9d95e5e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:32.200134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd954c955a93b4e2ebd7f7ab9e9d95e5e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:32.226805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd954c955a93b4e2ebd7f7ab9e9d95e5e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:32.263473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd954c955a93b4e2ebd7f7ab9e9d95e5e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:32.270645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd954c955a93b4e2ebd7f7ab9e9d95e5e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:32.288629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1126/2246] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:31 2022] DELETE /identity/v3/users/d954c955a93b4e2ebd7f7ab9e9d95e5e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:32.293860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:32.294350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:32.294601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:32.326334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:32.327901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:32.424472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1121/2247] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:32.434681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:32.436184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:32.508882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a140d-2010-4231-928c-3a21837c9618 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:32.525508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:32.528436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:32.528764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:32.528989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:32.540950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:32.542397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:32.563277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1127/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:33.059094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:33.060651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:33.079383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f01ed-c0af-4a4b-837b-e93932818289 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:33.108371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:33.122219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:33.122517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:33.122914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] PATH_INFO: `/v3/projects/d85d27239c894d18860a4d787b102e29` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:33.127468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85d27239c894d18860a4d787b102e29)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:33.133461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:33.222964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85d27239c894d18860a4d787b102e29', 'request_id': 'req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.233729 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85d27239c894d18860a4d787b102e29', 'request_id': 'req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.243158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85d27239c894d18860a4d787b102e29', 'request_id': 'req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.259604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] The token cache is being invalidate because project d85d27239c894d18860a4d787b102e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:33.260146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.262385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4d6b30bc-c1df-4e22-b477-c0c1519e0e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.271607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1122/2249] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:33 2022] DELETE /identity/v3/projects/d85d27239c894d18860a4d787b102e29 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:33.277586 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:33.291987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bda075-2167-44e8-a912-711fb133d6c9 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:33.417837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:33.418630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:33.418914 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:33.419185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] PATH_INFO: `/v3/users/fa0832b4366a4a16981e3e60bc784ae9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:33.420295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0832b4366a4a16981e3e60bc784ae9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:33.422719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:33.484080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0832b4366a4a16981e3e60bc784ae9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.485679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0832b4366a4a16981e3e60bc784ae9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.494371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:33.498020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0832b4366a4a16981e3e60bc784ae9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.531375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0832b4366a4a16981e3e60bc784ae9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.532262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0832b4366a4a16981e3e60bc784ae9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:33.540637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:33.541224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:33.541224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:33.549783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1128/2250] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:33 2022] DELETE /identity/v3/users/fa0832b4366a4a16981e3e60bc784ae9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:33.572052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:33.573366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:33.618131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:33.660250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1123/2251] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:33.674214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:33.676407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:33.779413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7295794-9164-49aa-963c-d2f0c61a14e0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:33.785154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:33.785881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:33.786254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:33.786679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:33.795613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:33.797285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2c98-2b08-44ca-a623-c54823dc8987 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:33.806287 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1129/2252] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:44:34.668295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:34.688083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:34.953629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80522a45-7ea7-4ab1-b3c4-20e5631fe8b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:34.967517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:34.970514 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:34.971009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:34.972646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] PATH_INFO: `/v3/projects/eaf6690e38114ee7afdb23b2aceec48f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:34.975783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf6690e38114ee7afdb23b2aceec48f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:34.979068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.051402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf6690e38114ee7afdb23b2aceec48f', 'request_id': 'req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:35.065076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf6690e38114ee7afdb23b2aceec48f', 'request_id': 'req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:35.075836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf6690e38114ee7afdb23b2aceec48f', 'request_id': 'req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:35.091143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] The token cache is being invalidate because project eaf6690e38114ee7afdb23b2aceec48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:35.091814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:35.093100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f68afa6-3a55-4e0f-beaa-e5b37d2b60b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:35.095375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1124/2253] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:34 2022] DELETE /identity/v3/projects/eaf6690e38114ee7afdb23b2aceec48f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:35.099964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.100506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.100617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.129790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:35.132357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:35.238488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1130/2254] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:35.246302 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.246816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.247293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.292685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:35.294003 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:35.310288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1125/2255] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:35.314454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.334011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee4ff-4ddb-428b-9ca9-5d2eb94a6074 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.342006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.342707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.342993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.343282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.343994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:35.344314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.346053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.370803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1131/2256] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:44:35.372006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.386475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2416a7-bf0c-4638-bf1f-bc0901b0c80f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.413011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.413738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.414085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.414330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.415054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.417930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.466486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1126/2257] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:35 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:35.467584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.485298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6036aa-1ca0-436d-8aa4-83a72013a596 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.604381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:35.639411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.640155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.640446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.640725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.641370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.644560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.709326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1132/2258] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:35 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:35.711405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.728724 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c4fbc-e779-4c57-b609-c553313ead9e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.741647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.746375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.746670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.746953 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.747630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.749341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.788972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1127/2259] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:35.790315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.804887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1a4e-6c9e-43ff-987a-5ddb2d50dcbf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.823848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.825322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.826392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.826679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.828643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.843273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc5c38-df3f-406a-b77f-a72e53f02eb7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.881851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1133/2260] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:35.883470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:35.894537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2117553-e6f1-4537-b161-11ecfe634946 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:35.900217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:35.901560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.902237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.902985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] PATH_INFO: `/v3/projects/6af7eb0848764564b32fd3923d5b37ca/users/95b2f891acb04a429cbd7798d9332f18/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:35.924305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af7eb0848764564b32fd3923d5b37ca, user_id=95b2f891acb04a429cbd7798d9332f18, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:35.930260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:35.965989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1128/2261] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:35 2022] PUT /identity/v3/projects/6af7eb0848764564b32fd3923d5b37ca/users/95b2f891acb04a429cbd7798d9332f18/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:35.978013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:35.978605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:35.979112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.050862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] MFA Rules not processed for user `95b2f891acb04a429cbd7798d9332f18`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:36.052000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:36.158543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1134/2262] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:36.163071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.175972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:36.265735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bef22-7914-44ae-a2fa-70c2bc8753bc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.272116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.272861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.273354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.273533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.274327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.276849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.315184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1129/2263] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:36.319585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.333004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c83a3-607b-46d9-b788-a0f9dfa4a372 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.398831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.399477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.399761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.400041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.401371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.402987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.437980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1135/2264] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:36 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:36.441607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.452879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e116de3-8803-41cb-9684-66a4383345a6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.458682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.460436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.461172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.461650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.462554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.464228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.476469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1130/2265] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:44:36.481364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.492688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929eea5-be45-4d9d-b064-88d44f34a661 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.497503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.498160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.498448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.498722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.499366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.500998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523c556-2135-4521-857f-b48548502b44 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.515369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1136/2266] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:36.517753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.531964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2385f-deb5-4bb4-a657-be31f7ab905a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.536988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.538254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.538553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.538814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] PATH_INFO: `/v3/projects/891b83efa8964cd3b1f7e83204df33cc/users/60531ec1854444afbe1a4189861fa84c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.563384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891b83efa8964cd3b1f7e83204df33cc, user_id=60531ec1854444afbe1a4189861fa84c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.566412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.598574 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1131/2267] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:36 2022] PUT /identity/v3/projects/891b83efa8964cd3b1f7e83204df33cc/users/60531ec1854444afbe1a4189861fa84c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:36.612366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.612932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.613360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.661189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] MFA Rules not processed for user `60531ec1854444afbe1a4189861fa84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:36.663214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:36.691048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:36.742571 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1137/2268] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:36.747333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.815926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93698c6c-9c50-4e12-8e04-cdec008ebda6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.820721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.821273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.821557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.821828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.822492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:36.824408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:36.854390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1132/2269] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:36.858494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:36.869384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c14048-acd6-40e9-bc3a-e99101e61d99 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:36.996268 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:36.997128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:36.997416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:36.997768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:36.998532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.001008 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.057406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1138/2270] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:36 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:44:37.061668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.074701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.079169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:37.085102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4def1-573b-4398-b2dd-c8e08f43cc3e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.095382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.096021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.096413 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.096728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.097407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.101163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.110128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c29d73-0934-4e25-81d1-9c7e12ebc7a0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.122649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1133/2271] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:37.125672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.127168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.127168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.127384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] PATH_INFO: `/v3/users/28faffc1c8d744d3a4a57bfa4610342c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.132697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28faffc1c8d744d3a4a57bfa4610342c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.134957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.136530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.147578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca54626-1564-44d7-8461-9a0f4e946cd0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.155446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.156474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.156939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.157360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] PATH_INFO: `/v3/projects/3f0e865820444ad89a12e70185b05bb2/users/ff9bb9254912442480a5b88d66e5c6c0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.207103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0e865820444ad89a12e70185b05bb2, user_id=ff9bb9254912442480a5b88d66e5c6c0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.212974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.254517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1134/2272] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:37 2022] PUT /identity/v3/projects/3f0e865820444ad89a12e70185b05bb2/users/ff9bb9254912442480a5b88d66e5c6c0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:37.255509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.294248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28faffc1c8d744d3a4a57bfa4610342c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:37.294248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28faffc1c8d744d3a4a57bfa4610342c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:37.297150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:37.309624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28faffc1c8d744d3a4a57bfa4610342c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:37.341668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28faffc1c8d744d3a4a57bfa4610342c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:37.348315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-67db0397-26ae-4c11-9bc4-ad5032debe6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28faffc1c8d744d3a4a57bfa4610342c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:37.370148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1139/2273] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:37 2022] DELETE /identity/v3/users/28faffc1c8d744d3a4a57bfa4610342c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:37.375668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.376100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.376521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.419115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:37.421229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:37.427106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53720e61-76f7-49df-a7a9-88aebaf3ad9c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.456462 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:37.556614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.557722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.558158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.558445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.559279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.561276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.574560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1135/2274] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:37.578813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.581392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:37.614509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c149-edfa-44ba-b242-8afc4fcf7a59 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.620122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1140/2275] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:37.628393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:37.633007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:37.639299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.639995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.640279 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.640557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] PATH_INFO: `/v3/projects/3f0e865820444ad89a12e70185b05bb2/users/ff9bb9254912442480a5b88d66e5c6c0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.647871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0e865820444ad89a12e70185b05bb2, user_id=ff9bb9254912442480a5b88d66e5c6c0, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.651570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ff80e-eb52-4b64-8400-3c34a963b626 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.715200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1136/2276] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:37 2022] PUT /identity/v3/projects/3f0e865820444ad89a12e70185b05bb2/users/ff9bb9254912442480a5b88d66e5c6c0/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:37.725482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.725971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.726308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.763921 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1578-c9f9-476f-97f6-29993c484a3c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:37.840690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] MFA Rules not processed for user `ff9bb9254912442480a5b88d66e5c6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:37.843221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:37.865458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:37.866458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:37.867266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:37.869037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:37.980133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:37.984819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:37.996241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1137/2277] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:38.000515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1141/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:38.020717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:38.023205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:38.093187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:38.140584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a67073-0890-4163-b649-805e8df7ea2b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:38.140584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:38.140584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:38.140584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:38.141089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:38.141089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:38.256158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:38.258038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:38.283539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1138/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:38.594617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:38.596236 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:38.617093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11aac7-531d-4694-b5c5-fdcb35de611a service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:38.636376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:38.637116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:38.637460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:38.637800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] PATH_INFO: `/v3/projects/091a9c4fa86e48259acf8a874d94ae0d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:38.639447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091a9c4fa86e48259acf8a874d94ae0d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:38.643961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:38.731377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:38.771392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091a9c4fa86e48259acf8a874d94ae0d', 'request_id': 'req-9fdbb525-fd45-4599-accf-417159701f20'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:38.794858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091a9c4fa86e48259acf8a874d94ae0d', 'request_id': 'req-9fdbb525-fd45-4599-accf-417159701f20'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:38.810978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091a9c4fa86e48259acf8a874d94ae0d', 'request_id': 'req-9fdbb525-fd45-4599-accf-417159701f20'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:38.822899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] The token cache is being invalidate because project 091a9c4fa86e48259acf8a874d94ae0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:38.823193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:38.823868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:38.825674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1142/2280] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:38 2022] DELETE /identity/v3/projects/091a9c4fa86e48259acf8a874d94ae0d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:40.439854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:40.442763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:40.467926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef14035-e76b-45f7-8ead-d66b1fe72530 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:40.559000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:40.559628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:40.559907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:40.560181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:40.562023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:40.640914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:40.642862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:40.654952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1139/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:41.335112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:41.337538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:41.351926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbb525-fd45-4599-accf-417159701f20 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:41.356172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:41.356645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:41.356834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:41.357114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:41.359389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:41.450381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:41.451768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ef60f-e726-4be8-8cf3-8b21c57d45b3 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:41.466424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1143/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:45.647616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:45.649979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:45.703369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:45.757185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6a88c-fecc-4093-a2cc-c9bf82278352 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:45.762446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:45.763760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:45.764832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:45.765221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] PATH_INFO: `/v3/users/95b2f891acb04a429cbd7798d9332f18` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:45.766539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b2f891acb04a429cbd7798d9332f18)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:45.768942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:45.845266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b2f891acb04a429cbd7798d9332f18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:45.846142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b2f891acb04a429cbd7798d9332f18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:45.853619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b2f891acb04a429cbd7798d9332f18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:45.870397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b2f891acb04a429cbd7798d9332f18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:45.871277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b2f891acb04a429cbd7798d9332f18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:45.887971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1140/2283] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:45 2022] DELETE /identity/v3/users/95b2f891acb04a429cbd7798d9332f18 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:45.892466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:45.893041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:45.893140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:45.919348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:45.921226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:46.006802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1144/2284] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:46.016444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:46.017898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:46.082075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc737-8cb5-4131-9ff3-d40f2c1090b3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:46.085817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:46.086512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:46.086792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:46.087061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:46.097842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:46.099321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:46.111855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1141/2285] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:46.472420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:46.474765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:46.488934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e84b-2d09-45e4-852f-f9d75fcde505 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:46.493560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:46.494294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:46.494672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:46.495014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] PATH_INFO: `/v3/projects/6af7eb0848764564b32fd3923d5b37ca` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:46.496200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af7eb0848764564b32fd3923d5b37ca)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:46.498231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:46.561009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:46.565608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af7eb0848764564b32fd3923d5b37ca', 'request_id': 'req-803d1dc3-5c43-4166-b904-db776fe7956b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.579070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af7eb0848764564b32fd3923d5b37ca', 'request_id': 'req-803d1dc3-5c43-4166-b904-db776fe7956b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.590867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af7eb0848764564b32fd3923d5b37ca', 'request_id': 'req-803d1dc3-5c43-4166-b904-db776fe7956b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.606075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] The token cache is being invalidate because project 6af7eb0848764564b32fd3923d5b37ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:46.606498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.607289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.609217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1145/2286] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:46 2022] DELETE /identity/v3/projects/6af7eb0848764564b32fd3923d5b37ca => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:46.613191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:46.633793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88d9fe-0952-46a8-83d5-f78deb8be135 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:46.700122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:46.710329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:46.711295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:46.711756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:46.712108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] PATH_INFO: `/v3/users/60531ec1854444afbe1a4189861fa84c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:46.713893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60531ec1854444afbe1a4189861fa84c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:46.716304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:46.774403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60531ec1854444afbe1a4189861fa84c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.775263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60531ec1854444afbe1a4189861fa84c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.786502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60531ec1854444afbe1a4189861fa84c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.807157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60531ec1854444afbe1a4189861fa84c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.807972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60531ec1854444afbe1a4189861fa84c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:46.835797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1142/2287] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:46 2022] DELETE /identity/v3/users/60531ec1854444afbe1a4189861fa84c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:47.258861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:47.260332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:47.274290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d1dc3-5c43-4166-b904-db776fe7956b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:47.332915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:47.333547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:47.333831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:47.334141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] PATH_INFO: `/v3/projects/891b83efa8964cd3b1f7e83204df33cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:47.335770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=891b83efa8964cd3b1f7e83204df33cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:47.337673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:47.384546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891b83efa8964cd3b1f7e83204df33cc', 'request_id': 'req-bdb6338a-692c-4a18-b51e-4e63efb79dce'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.392017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891b83efa8964cd3b1f7e83204df33cc', 'request_id': 'req-bdb6338a-692c-4a18-b51e-4e63efb79dce'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.398796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891b83efa8964cd3b1f7e83204df33cc', 'request_id': 'req-bdb6338a-692c-4a18-b51e-4e63efb79dce'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.410733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] The token cache is being invalidate because project 891b83efa8964cd3b1f7e83204df33cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:47.411010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.411657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.413966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1146/2288] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:47 2022] DELETE /identity/v3/projects/891b83efa8964cd3b1f7e83204df33cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:47.417992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:47.419914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:47.434167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592a6e-0b5c-40bb-bcc5-08887790c0d0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:47.495688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:47.496325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:47.496607 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:47.496883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] PATH_INFO: `/v3/users/ff9bb9254912442480a5b88d66e5c6c0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:47.498023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9bb9254912442480a5b88d66e5c6c0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:47.499966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:47.545713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9bb9254912442480a5b88d66e5c6c0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.546398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9bb9254912442480a5b88d66e5c6c0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.553151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9bb9254912442480a5b88d66e5c6c0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.564872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9bb9254912442480a5b88d66e5c6c0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.565506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9bb9254912442480a5b88d66e5c6c0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:47.569050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:47.579817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1143/2289] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:47 2022] DELETE /identity/v3/users/ff9bb9254912442480a5b88d66e5c6c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:47.868351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:47.869702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:47.884742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6338a-692c-4a18-b51e-4e63efb79dce admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:47.905210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:47.907341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:47.971930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:47.973150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:47.973443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:47.973726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] PATH_INFO: `/v3/users/e390463bd7da42819946547393decb77` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:47.975159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e390463bd7da42819946547393decb77)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:47.977181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:47.983035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:48.030265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98b7fe-795a-4ca9-ba07-745e2041b264 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.036389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.037031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.037330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.037626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] PATH_INFO: `/v3/projects/3f0e865820444ad89a12e70185b05bb2` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.039267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0e865820444ad89a12e70185b05bb2)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.041544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.047648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e390463bd7da42819946547393decb77'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.048442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e390463bd7da42819946547393decb77'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.057478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e390463bd7da42819946547393decb77'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.074411 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e390463bd7da42819946547393decb77'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.075380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-38538f8f-0590-4859-aeaa-6384efd3e078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e390463bd7da42819946547393decb77'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.091882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1147/2290] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:44:47 2022] DELETE /identity/v3/users/e390463bd7da42819946547393decb77 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:48.096261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.096555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.096823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.101728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0e865820444ad89a12e70185b05bb2', 'request_id': 'req-dbca3a3d-a31a-45f4-8213-29574f620eca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.111253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0e865820444ad89a12e70185b05bb2', 'request_id': 'req-dbca3a3d-a31a-45f4-8213-29574f620eca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.119298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0e865820444ad89a12e70185b05bb2', 'request_id': 'req-dbca3a3d-a31a-45f4-8213-29574f620eca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.119645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:48.120871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.136755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] The token cache is being invalidate because project 3f0e865820444ad89a12e70185b05bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:48.137128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.137722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dbca3a3d-a31a-45f4-8213-29574f620eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.139564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1144/2291] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:47 2022] DELETE /identity/v3/projects/3f0e865820444ad89a12e70185b05bb2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:48.144515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b690-945b-4414-9561-7892a608e148 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.144806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b690-945b-4414-9561-7892a608e148 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.145166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b690-945b-4414-9561-7892a608e148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.167010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ca30b690-945b-4414-9561-7892a608e148 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:48.168296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca30b690-945b-4414-9561-7892a608e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.201771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1148/2292] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:48.222351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.223829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.281981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1145/2293] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:48.318476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbcb26-6cdc-4fb3-88e9-8dea1e5f9c9d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.324100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.324100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.324100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.324501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.336425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.346222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.346412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.346412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.346412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.350946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1149/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:44:48.370356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:48.371553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.379978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1146/2295] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:48.384342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.394034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93d44-ed45-4a0c-b350-b77206d7f08e service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.399010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.399551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.399828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.400096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.400737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:44:48.401802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.402887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.431907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1150/2296] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:44:48.433001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.466900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814fa7-9d27-4b52-8d0b-d85203c5df98 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.472774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.473512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.473852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.474254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.475266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.478151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.502428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:48.520854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1147/2297] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:48.522039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.534708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618a813-df79-418a-bce5-ff57deb9b6cf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.547701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:48.610581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.611285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.611654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.612023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.612747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.614834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.638479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1151/2298] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:48.642847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.654806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949122-38e1-4636-a7bb-44e4522b766b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.659593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.660212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.660494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.661206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.661416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.663484 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.674341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1148/2299] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:44:48.679912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.692701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74a29-187c-48f2-bf04-69a6b3384791 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.698220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.698861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.699138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.699435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.700081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.701689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.705967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.707825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.715102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1152/2300] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:48.718835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.723512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e36-9634-4460-88d4-e328aed3380b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.729300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.730062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.731038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.731395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] PATH_INFO: `/v3/projects/1a046aab888e4cea86ba7371a6ee32b4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.732708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a046aab888e4cea86ba7371a6ee32b4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.735113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.754750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ea08-61f5-4bb4-a971-c0793d7cb457 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:48.760848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:48.761500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.761780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.762091 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] PATH_INFO: `/v3/projects/b772f101e8544e87baf123e282c5df06/users/23f524ee77fd463987420bf6b9386dc1/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.778950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b772f101e8544e87baf123e282c5df06, user_id=23f524ee77fd463987420bf6b9386dc1, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:48.781754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe83bb-2e6d-48c6-90ef-a9822ac2f009 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:48.790473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a046aab888e4cea86ba7371a6ee32b4', 'request_id': 'req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.797253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1153/2301] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:48 2022] PUT /identity/v3/projects/b772f101e8544e87baf123e282c5df06/users/23f524ee77fd463987420bf6b9386dc1/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:48.798750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a046aab888e4cea86ba7371a6ee32b4', 'request_id': 'req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.802166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63af5-ff0e-4a0a-a536-e8b29388c268 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:48.802451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63af5-ff0e-4a0a-a536-e8b29388c268 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:48.802724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63af5-ff0e-4a0a-a536-e8b29388c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:48.808382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a046aab888e4cea86ba7371a6ee32b4', 'request_id': 'req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.822168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] The token cache is being invalidate because project 1a046aab888e4cea86ba7371a6ee32b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:44:48.822458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.823113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:44:48.823323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-79e63af5-ff0e-4a0a-a536-e8b29388c268 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:48.824534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-79e63af5-ff0e-4a0a-a536-e8b29388c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.824656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1149/2302] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:44:48 2022] DELETE /identity/v3/projects/1a046aab888e4cea86ba7371a6ee32b4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:44:48.899804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1154/2303] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:44:48.907078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:48.908939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:48.978371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98bd7-c081-4aa7-8c93-2038bc75c4ca admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:49.045738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:49.046388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:49.046671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:49.046946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:49.056767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:49.058212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:49.067982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1150/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:44:50.230428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ddd7-173c-4609-8a74-7ae063e4572a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:50.230951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ddd7-173c-4609-8a74-7ae063e4572a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:50.231045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ddd7-173c-4609-8a74-7ae063e4572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:50.251081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8018ddd7-173c-4609-8a74-7ae063e4572a None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:50.252316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8018ddd7-173c-4609-8a74-7ae063e4572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:50.316153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1155/2305] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:50.332340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:50.333878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:50.370666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:50.417828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8076-bd91-4c31-858d-20f972f7e34f service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:50.423112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:50.423979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:50.424350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:50.424748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:50.434817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:50.436553 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:50.453805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1151/2306] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:44:57.464660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:57.465200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:57.465200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:57.560490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:44:57.567021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] MFA Rules not processed for user `23f524ee77fd463987420bf6b9386dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:44:57.568428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:57.737464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1156/2307] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:44:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:44:57.742554 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:57.744183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:44:57.774171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955d4bf-c5b1-4b02-8858-8881703028a1 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:57.787410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:57.795815 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:57.796501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:57.796501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:57.798706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:57.803612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:57.883639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1152/2308] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:44:57 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:57.884965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:57.901375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb916a0d-74f8-45f7-bdcd-5b9105b5f673 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:58.045642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:58.046258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:58.046683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:58.047803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:58.048743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:58.054138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:58.110958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:58.116907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1157/2309] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:44:57 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:44:58.126071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e1830-eed8-41ae-a2da-37456b6851b6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:58.147338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:58.147978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:58.149052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:58.149647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:58.150350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:58.159305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:58.199771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1153/2310] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:58.200758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:58.213507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268f0f0-6dcc-4fdd-b314-52aa0415d718 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:58.226888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:58.227568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:58.227951 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:58.228114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] PATH_INFO: `/v3/projects/4b87db69302049d0a733326bdadfb4c0/users/fe7ea8ba5144438e876d1c967c259cbe/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:58.294844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87db69302049d0a733326bdadfb4c0, user_id=fe7ea8ba5144438e876d1c967c259cbe, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:58.298554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:58.362123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1158/2311] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:58 2022] PUT /identity/v3/projects/4b87db69302049d0a733326bdadfb4c0/users/fe7ea8ba5144438e876d1c967c259cbe/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:44:58.368236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:58.385178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b499-2074-4d98-90e0-1a06f4877fa0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:58.538242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:58.538242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:58.538242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:58.538242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:58.539344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:58.539344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047708ae-df55-44b0-8662-daefbb333c78 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:58.563064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1154/2312] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:44:58.566955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:44:58.586635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92fce-fbed-4c9f-ace6-c91a7ce7de1e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:44:58.592081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:44:58.592768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:44:58.593052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:44:58.593337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] PATH_INFO: `/v3/projects/4b87db69302049d0a733326bdadfb4c0/users/fe7ea8ba5144438e876d1c967c259cbe/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:44:58.595444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87db69302049d0a733326bdadfb4c0, user_id=fe7ea8ba5144438e876d1c967c259cbe, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:44:58.598711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:44:58.625783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1159/2313] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:44:58 2022] PUT /identity/v3/projects/4b87db69302049d0a733326bdadfb4c0/users/fe7ea8ba5144438e876d1c967c259cbe/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:45:00.495076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecdf1-21ae-4d14-8384-0c10a71ea689 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:00.496039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecdf1-21ae-4d14-8384-0c10a71ea689 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:00.496619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ecdf1-21ae-4d14-8384-0c10a71ea689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:00.539622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ef2ecdf1-21ae-4d14-8384-0c10a71ea689 None None] MFA Rules not processed for user `3b06d6cf9b694708a25c0c974558c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:00.544851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ef2ecdf1-21ae-4d14-8384-0c10a71ea689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:00.843877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1155/2314] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:45:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:03.939949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:03.943338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:04.149986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab6dd0-181d-44ae-aab7-6d88366f9818 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:04.161556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:04.162244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:04.162528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:04.162808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:04.181725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:04.212875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:04.365324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:04.365324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:04.385762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1160/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:45:10.797236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:13.436822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743780b-73d5-4fb5-8828-05b1eac8a260 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:13.437347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743780b-73d5-4fb5-8828-05b1eac8a260 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:13.437347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743780b-73d5-4fb5-8828-05b1eac8a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:13.465796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e743780b-73d5-4fb5-8828-05b1eac8a260 None None] MFA Rules not processed for user `fe7ea8ba5144438e876d1c967c259cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:13.467041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e743780b-73d5-4fb5-8828-05b1eac8a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:13.537232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1156/2316] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:45:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:13.551336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:13.552725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:13.627821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287687b-7083-4b05-8ce6-6d367f347ee5 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:13.633533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:13.634353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:13.634581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:13.634986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:13.694802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:13.696365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f64d90-52c7-427c-bd35-7b76f51803d4 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:13.705654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1161/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:45:14.990753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31698fe-e602-49cb-ba12-7b8a4d63adf8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:14.994153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31698fe-e602-49cb-ba12-7b8a4d63adf8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:14.994839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31698fe-e602-49cb-ba12-7b8a4d63adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:15.035594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f31698fe-e602-49cb-ba12-7b8a4d63adf8 None None] MFA Rules not processed for user `23f524ee77fd463987420bf6b9386dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:15.036832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f31698fe-e602-49cb-ba12-7b8a4d63adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:15.044329 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1157/2318] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:16.410584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.411109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.411210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.412704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1162/2319] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:45:16.419613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1e84-0cf2-459b-a82b-505e996ecd9b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.420163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1e84-0cf2-459b-a82b-505e996ecd9b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.420738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1e84-0cf2-459b-a82b-505e996ecd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.443609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9d4e1e84-0cf2-459b-a82b-505e996ecd9b None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:16.445000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9d4e1e84-0cf2-459b-a82b-505e996ecd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:16.460089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1158/2320] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:16.475234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:16.477423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:16.538947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:16.553078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1015123-c9df-4754-9031-1f7b2471133d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:16.558137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:16.558763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.559048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.559324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.572101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:16.573546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f856d5-02c9-4ec7-ad5e-9f9a79b2ded6 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:16.588023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1163/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:45:16.674081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde2d6-5357-4938-96ea-7285098288ec None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.674371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde2d6-5357-4938-96ea-7285098288ec None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.674649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde2d6-5357-4938-96ea-7285098288ec None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.676002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1159/2322] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:45:16.681475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c830a8-71e8-40b4-a6ed-06ecc992c6be None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.681834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c830a8-71e8-40b4-a6ed-06ecc992c6be None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.682261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c830a8-71e8-40b4-a6ed-06ecc992c6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.703605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04c830a8-71e8-40b4-a6ed-06ecc992c6be None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:16.704895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04c830a8-71e8-40b4-a6ed-06ecc992c6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:16.713649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1164/2323] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:45:16.724436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde2d6-5357-4938-96ea-7285098288ec None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:16.736701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde2d6-5357-4938-96ea-7285098288ec None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:16.740183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:16.740778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.741055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.741324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.749106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:16.750560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5fda-43a3-459e-b0b2-3af1217ae782 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:16.758183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1160/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:45:16.848271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dd0-373e-4b8b-aab5-31f5351afd9c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.848843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dd0-373e-4b8b-aab5-31f5351afd9c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.849323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01649dd0-373e-4b8b-aab5-31f5351afd9c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.851807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1165/2325] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:45:16.857555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808aa0-ffdc-48c8-abaa-b8363674f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.857840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808aa0-ffdc-48c8-abaa-b8363674f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.858427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808aa0-ffdc-48c8-abaa-b8363674f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.881734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-eb808aa0-ffdc-48c8-abaa-b8363674f1f3 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:16.883381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb808aa0-ffdc-48c8-abaa-b8363674f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:16.893871 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1161/2326] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:16.905211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649dd0-373e-4b8b-aab5-31f5351afd9c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:16.922520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01649dd0-373e-4b8b-aab5-31f5351afd9c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:16.926443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:16.927098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:16.927377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:16.927648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:16.940291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:16.941822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:16.953890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1166/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:45:20.924507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:20.925060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:20.925060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:20.944638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:20.945872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:21.000919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1162/2328] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:45:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:45:21.023735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:21.090994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace669fc-9ead-42e1-a658-20b8da9a1151 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:21.095879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:21.096508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:21.096792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:21.097068 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:21.105876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:21.107500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f775-a7bf-4df3-bcd5-e2ebb3da8bdf service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:21.115961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1167/2329] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:45:30.994249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=74 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:31.112575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=48 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:40.125083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:40.126524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:40.194898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298718-f648-494b-983c-f6ff00f9afa4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:40.199839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:40.200447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:40.200728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:40.201004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:40.202709 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:40.214372 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:40.215946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:40.225579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1163/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:45:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:45:41.165084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b297-0dd4-4add-a7f9-aaca6a7aee30 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:41.165562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b297-0dd4-4add-a7f9-aaca6a7aee30 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:41.165672 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b297-0dd4-4add-a7f9-aaca6a7aee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:41.185539 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-13b4b297-0dd4-4add-a7f9-aaca6a7aee30 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:45:41.186828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-13b4b297-0dd4-4add-a7f9-aaca6a7aee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:45:41.194163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1168/2331] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:45:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:45:41.208144 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:45:41.220032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d10db-6341-41f0-9601-944b1398b041 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:45:41.225002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:45:41.225748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:45:41.226067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:45:41.226345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:45:41.235337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:45:41.237247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab975dc-ec28-4c7d-b6a0-8b025b239ea6 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:45:41.245907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1164/2332] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:45:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:45:51.179306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:45:51.242210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=38 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:02.475911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8512-0a23-43dc-9d81-da569543f69c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:02.476426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8512-0a23-43dc-9d81-da569543f69c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:02.476527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca8512-0a23-43dc-9d81-da569543f69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:02.496137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e9ca8512-0a23-43dc-9d81-da569543f69c None None] MFA Rules not processed for user `06577b267fec462c87bfff97abe065de`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:46:02.497319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e9ca8512-0a23-43dc-9d81-da569543f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:02.552262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1169/2333] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:46:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:46:12.545584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=25 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:31.316737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:31.317267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:31.317374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:31.337461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] MFA Rules not processed for user `3b06d6cf9b694708a25c0c974558c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:46:31.338688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:31.345661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1165/2334] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:46:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:46:33.155658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:33.156946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:33.157532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:33.179307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] MFA Rules not processed for user `f4800b1e92614f72981cbf6bb4279aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:46:33.180874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:33.246496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1170/2335] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:46:41.063696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:46:41.130655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac3578-bd6f-4a22-8e52-6b3089d01cb6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:46:41.135848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:46:41.136956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:41.137464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:41.138047 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] PATH_INFO: `/v3/users/23f524ee77fd463987420bf6b9386dc1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:41.139495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f524ee77fd463987420bf6b9386dc1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:46:41.141881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:46:41.198081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f524ee77fd463987420bf6b9386dc1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.198840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f524ee77fd463987420bf6b9386dc1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.206499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f524ee77fd463987420bf6b9386dc1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.219748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f524ee77fd463987420bf6b9386dc1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.220459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f524ee77fd463987420bf6b9386dc1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.234235 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1166/2336] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:46:41 2022] DELETE /identity/v3/users/23f524ee77fd463987420bf6b9386dc1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:46:41.764908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:46:41.776709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083295a9-1889-4f99-8435-a390f5961f82 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:46:41.849232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:46:41.849963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:41.850306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:41.850816 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] PATH_INFO: `/v3/projects/b772f101e8544e87baf123e282c5df06` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:41.852179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b772f101e8544e87baf123e282c5df06)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:46:41.854927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:46:41.919920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b772f101e8544e87baf123e282c5df06', 'request_id': 'req-f5217bbf-96eb-4313-95a2-8c098c59f4ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.929839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b772f101e8544e87baf123e282c5df06', 'request_id': 'req-f5217bbf-96eb-4313-95a2-8c098c59f4ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.940788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b772f101e8544e87baf123e282c5df06', 'request_id': 'req-f5217bbf-96eb-4313-95a2-8c098c59f4ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.953897 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] The token cache is being invalidate because project b772f101e8544e87baf123e282c5df06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:46:41.954219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.954877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:41.956382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1171/2337] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:46:41 2022] DELETE /identity/v3/projects/b772f101e8544e87baf123e282c5df06 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:46:41.960481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:46:41.961895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:41.979312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50827e02-579c-4321-b154-eb6efcf0c5df admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:46:42.038462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:46:42.039018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:42.039298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:42.039572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] PATH_INFO: `/v3/users/fe7ea8ba5144438e876d1c967c259cbe` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:42.041322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7ea8ba5144438e876d1c967c259cbe)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:46:42.043251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:46:42.057919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:42.093389 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7ea8ba5144438e876d1c967c259cbe'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.094384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7ea8ba5144438e876d1c967c259cbe'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.100804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7ea8ba5144438e876d1c967c259cbe'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.112393 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7ea8ba5144438e876d1c967c259cbe'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.113052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-76904f9f-23c9-4100-9e47-27de2ef2cb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7ea8ba5144438e876d1c967c259cbe'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.125466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1167/2338] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:46:41 2022] DELETE /identity/v3/users/fe7ea8ba5144438e876d1c967c259cbe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:46:42.310108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:46:42.311702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:42.329180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217bbf-96eb-4313-95a2-8c098c59f4ea admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:46:42.372859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:42.400302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:46:42.400941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:42.401225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:42.401521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] PATH_INFO: `/v3/projects/4b87db69302049d0a733326bdadfb4c0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:42.402637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b87db69302049d0a733326bdadfb4c0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:46:42.404556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:46:42.458697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b87db69302049d0a733326bdadfb4c0', 'request_id': 'req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.467095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b87db69302049d0a733326bdadfb4c0', 'request_id': 'req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.475535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b87db69302049d0a733326bdadfb4c0', 'request_id': 'req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.487254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] The token cache is being invalidate because project 4b87db69302049d0a733326bdadfb4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:46:42.488163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.488447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:46:42.490509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1172/2339] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:46:42 2022] DELETE /identity/v3/projects/4b87db69302049d0a733326bdadfb4c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:46:52.122001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:52.483957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:46:57.696601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:57.697017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:57.697160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:57.716467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:46:57.717656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:57.771400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1168/2340] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:46:57.824575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:46:57.826078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:46:57.895501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360ba0-a0cd-47ea-964f-5fd9e994fe5b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:46:57.900541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:46:57.901635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:46:57.901912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:46:57.902207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:46:57.910286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:46:57.911861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:46:57.920381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1173/2341] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:47:04.667386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:04.668917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:04.738145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16406f-79cf-4500-bdc3-8aabd54dd061 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:04.742893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:04.743588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:04.743937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:04.744321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] PATH_INFO: `/v3/users/f55f72d0874d4f578c3ae5721aeae429` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:04.745631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55f72d0874d4f578c3ae5721aeae429)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:04.747642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:04.795968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55f72d0874d4f578c3ae5721aeae429'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:04.797129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55f72d0874d4f578c3ae5721aeae429'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:04.804366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55f72d0874d4f578c3ae5721aeae429'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:04.818758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55f72d0874d4f578c3ae5721aeae429'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:04.819711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55f72d0874d4f578c3ae5721aeae429'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:04.833032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1169/2342] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:04 2022] DELETE /identity/v3/users/f55f72d0874d4f578c3ae5721aeae429 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:05.017853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:05.030027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be737-3ab2-4c14-b8cf-b9a7ea121b7a service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:05.090121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:05.090752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:05.091029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:05.091421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] PATH_INFO: `/v3/projects/5b63022c1d844855b1b7cbdf09efa0b6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:05.092557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b63022c1d844855b1b7cbdf09efa0b6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:05.094465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:05.140372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b63022c1d844855b1b7cbdf09efa0b6', 'request_id': 'req-b4677d26-219a-4d69-ba3b-5644ab35422d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.147098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b63022c1d844855b1b7cbdf09efa0b6', 'request_id': 'req-b4677d26-219a-4d69-ba3b-5644ab35422d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.154145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b63022c1d844855b1b7cbdf09efa0b6', 'request_id': 'req-b4677d26-219a-4d69-ba3b-5644ab35422d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.164470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] The token cache is being invalidate because project 5b63022c1d844855b1b7cbdf09efa0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:05.164754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.165376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.166868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1174/2343] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:05 2022] DELETE /identity/v3/projects/5b63022c1d844855b1b7cbdf09efa0b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:05.170942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:05.172326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:05.193733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0ef0-9163-4729-bc7d-0846d52956e6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:05.214683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:05.251230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:05.251863 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:05.252150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:05.252429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] PATH_INFO: `/v3/users/bf2a63ec5c8b4d4faed321f65634cc21` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:05.253540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2a63ec5c8b4d4faed321f65634cc21)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:05.255490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:05.301745 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2a63ec5c8b4d4faed321f65634cc21'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.302422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2a63ec5c8b4d4faed321f65634cc21'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.309587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2a63ec5c8b4d4faed321f65634cc21'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.321122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2a63ec5c8b4d4faed321f65634cc21'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.321741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ff5bfb2a-db07-43f9-a347-09388655e72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2a63ec5c8b4d4faed321f65634cc21'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.334955 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1170/2344] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:05 2022] DELETE /identity/v3/users/bf2a63ec5c8b4d4faed321f65634cc21 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:05.508629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:05.510102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:05.523520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677d26-219a-4d69-ba3b-5644ab35422d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:05.541011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:05.582691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:05.583318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:05.583594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:05.583863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] PATH_INFO: `/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:05.584956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f3b520440c4ed1ba7b5f4e49f3c111)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:05.586886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:05.632806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f3b520440c4ed1ba7b5f4e49f3c111', 'request_id': 'req-d37d953a-a48c-401d-b814-74a1afa3fdc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.640139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f3b520440c4ed1ba7b5f4e49f3c111', 'request_id': 'req-d37d953a-a48c-401d-b814-74a1afa3fdc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.646357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f3b520440c4ed1ba7b5f4e49f3c111', 'request_id': 'req-d37d953a-a48c-401d-b814-74a1afa3fdc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.656475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] The token cache is being invalidate because project 20f3b520440c4ed1ba7b5f4e49f3c111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:05.656765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.657643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:05.659348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1175/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:05 2022] DELETE /identity/v3/projects/20f3b520440c4ed1ba7b5f4e49f3c111 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:10.457898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:10.458436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:10.458552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:10.477958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] MFA Rules not processed for user `06577b267fec462c87bfff97abe065de`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:10.479176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:10.534113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1171/2346] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:15.653607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:20.526572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:33.703158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:33.705410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:33.785679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d953a-a48c-401d-b814-74a1afa3fdc6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:33.791029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:33.793101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:33.793404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:33.793699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:33.796979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:33.876449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:33.877901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97740096-4d31-4960-88fe-83c6791c8dff service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:33.890238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1176/2347] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:39.097994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:39.099376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:39.112143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7b9a4-6d82-4f62-9e73-3553bdee1f45 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:39.115773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:39.116394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:39.116670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:39.116936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:39.118755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:39.196358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:39.197997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:39.209997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1172/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:40.332666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:40.333221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:40.333221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:40.358952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] MFA Rules not processed for user `7cf7b00dc3c84466a89ecfcd76bd1a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:40.360358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:40.429879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1177/2349] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:42.590149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:42.592427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:42.606947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82a960-22cf-4646-8f64-2a308615c4a4 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:42.612311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:42.618817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:42.619143 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:42.619428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] PATH_INFO: `/v3/users/3b06d6cf9b694708a25c0c974558c29d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:42.620742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b06d6cf9b694708a25c0c974558c29d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:42.622945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:42.686512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b06d6cf9b694708a25c0c974558c29d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:42.689063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b06d6cf9b694708a25c0c974558c29d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:42.698801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b06d6cf9b694708a25c0c974558c29d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:42.715200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b06d6cf9b694708a25c0c974558c29d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:42.716540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-11334535-dcdd-44c8-87a0-ec0b0a552f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b06d6cf9b694708a25c0c974558c29d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:42.731135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1173/2350] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:42 2022] DELETE /identity/v3/users/3b06d6cf9b694708a25c0c974558c29d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:43.016172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.028543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576558c0-7e2d-4a30-a02e-eae7451adad1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.079182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:43.092719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.093440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.093751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.094061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] PATH_INFO: `/v3/projects/9b0ad289e3494efa9a80ab5ec7593c7b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.095184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0ad289e3494efa9a80ab5ec7593c7b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.097107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.143804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0ad289e3494efa9a80ab5ec7593c7b', 'request_id': 'req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:43.152624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0ad289e3494efa9a80ab5ec7593c7b', 'request_id': 'req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:43.160131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0ad289e3494efa9a80ab5ec7593c7b', 'request_id': 'req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:43.170949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] The token cache is being invalidate because project 9b0ad289e3494efa9a80ab5ec7593c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:43.171243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:43.171917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b7bd15a1-bd8f-4157-8e1a-4349a0bd771f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:43.173415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1178/2351] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:43 2022] DELETE /identity/v3/projects/9b0ad289e3494efa9a80ab5ec7593c7b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:43.178944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.179309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.179685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.200652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:43.201874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:43.263778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1174/2352] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:47:43.271727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.272068 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.272349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.294738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:43.295960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:43.303949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1179/2353] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:43.308274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.319048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033a9f-3d8a-4030-825d-d358589498cc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.323645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.324266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.324548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.324818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.326089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:47:43.326393 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.327977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.329543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:43.343816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1175/2354] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:47:43.348680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.358098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584b0d6-2658-44f1-8113-c991d229ce7d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.362874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.363469 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.363743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.364037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.364699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.366627 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.398162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1180/2355] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:43 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:43.399670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.411010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2122d-0928-4716-a1b8-81894d58e9d6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.468910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.469529 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.469812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.470120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.470792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.472970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.499234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1176/2356] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:43 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:43.503608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.514669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3c55-d23c-440e-a715-d0a23ec87743 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.519444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.520046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.520323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.520596 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.521243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.522887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.533432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1181/2357] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:43.537661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.547793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2800-5d49-44e3-89f6-d27a23cf4d85 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.553035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.553647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.553919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.554229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.554872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.556461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7275-3cd6-4fa0-9cbe-652b0b782b2d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.567817 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1177/2358] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:43.572145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.583855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79eb3-9cf9-4dcd-a3b1-35ed361900da admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.589158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.589820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.590310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.590496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] PATH_INFO: `/v3/projects/0dfc28ddbf6c4fbfa95fba25bdd5686d/users/7e94825f5b9e4951b35abafd9443c222/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.606272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfc28ddbf6c4fbfa95fba25bdd5686d, user_id=7e94825f5b9e4951b35abafd9443c222, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.609103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.624456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1182/2359] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:43 2022] PUT /identity/v3/projects/0dfc28ddbf6c4fbfa95fba25bdd5686d/users/7e94825f5b9e4951b35abafd9443c222/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:43.630070 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f892f9-54e6-4e17-b733-7f8c909efd8f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.631076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f892f9-54e6-4e17-b733-7f8c909efd8f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.632295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f892f9-54e6-4e17-b733-7f8c909efd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.660339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-64f892f9-54e6-4e17-b733-7f8c909efd8f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:43.660579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-64f892f9-54e6-4e17-b733-7f8c909efd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:43.735256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1178/2360] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:43.748379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:43.750223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:43.839489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622becc-f452-4548-b913-d5fc50ab6d3f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:43.843945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:43.844749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:43.844884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:43.845228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:43.861229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:43.862872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:43.883882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1183/2361] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:44.671769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:44.672308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:44.672308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:44.705733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] MFA Rules not processed for user `7e94825f5b9e4951b35abafd9443c222`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:44.707127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:44.786036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1179/2362] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:44.790673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:44.801703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e0246-fa11-4af0-aafe-4892fe51242b service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:44.807425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:44.808293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:44.808646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:44.808993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:44.809803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:44.811936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:44.828556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:44.850196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1184/2363] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:44 2022] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:44.851271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:44.858231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:44.864890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3ec3-ae38-4568-93a1-9a900f0826ff None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:44.931419 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:44.932057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:44.932343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:44.932623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:44.933548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:44.935614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:44.964737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1180/2364] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:44 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:44.969166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:44.984881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a4de-342e-4712-a8c6-508420d99089 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:44.990219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:44.991043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:44.991211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:44.991605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:44.992360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:44.994412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:45.007814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1185/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:45.011524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:45.022978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39d6e-776c-4387-9e15-b9f43fd74765 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:45.029644 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:45.030476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:45.030825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:45.031171 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] PATH_INFO: `/v3/projects/b160471fce5341e99e21bff678f8a157/users/ef43a37bbbff4b86af96ae38122c5ea2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:45.049703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160471fce5341e99e21bff678f8a157, user_id=ef43a37bbbff4b86af96ae38122c5ea2, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:45.052471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:45.072057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1181/2366] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:45 2022] PUT /identity/v3/projects/b160471fce5341e99e21bff678f8a157/users/ef43a37bbbff4b86af96ae38122c5ea2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:45.077089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:45.089081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12735b2-0a4f-4dcf-bc6f-72842b5770fe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:45.157587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:45.158735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:45.159480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:45.159938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:45.161147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:45.162813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dde7e-89fd-4172-9a4e-a4a9fe7c00c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:45.175383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1186/2367] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:45.179938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:45.191912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65d168-fcbd-43c9-a655-7e593a39e1ae admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:45.198584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:45.199361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:45.199719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:45.200132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] PATH_INFO: `/v3/projects/b160471fce5341e99e21bff678f8a157/users/ef43a37bbbff4b86af96ae38122c5ea2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:45.202673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160471fce5341e99e21bff678f8a157, user_id=ef43a37bbbff4b86af96ae38122c5ea2, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:45.205664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:45.216931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1182/2368] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:45 2022] PUT /identity/v3/projects/b160471fce5341e99e21bff678f8a157/users/ef43a37bbbff4b86af96ae38122c5ea2/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:45.849183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:45.849665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:45.849847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:45.879717 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] MFA Rules not processed for user `ef43a37bbbff4b86af96ae38122c5ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:45.881076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:45.951674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1187/2369] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:47.275946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:47.344262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9838-b9e5-4d8e-9c9f-c2cd194e708c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:47.348735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496638-0552-444e-a737-98616d87d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:47.349351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496638-0552-444e-a737-98616d87d1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:47.349629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496638-0552-444e-a737-98616d87d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:47.349901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59496638-0552-444e-a737-98616d87d1da admin admin] PATH_INFO: `/v3/users/7e94825f5b9e4951b35abafd9443c222` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:47.351029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59496638-0552-444e-a737-98616d87d1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e94825f5b9e4951b35abafd9443c222)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:47.352915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59496638-0552-444e-a737-98616d87d1da admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:47.397696 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e94825f5b9e4951b35abafd9443c222'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.398385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e94825f5b9e4951b35abafd9443c222'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.405705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e94825f5b9e4951b35abafd9443c222'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.406825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:47.420785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e94825f5b9e4951b35abafd9443c222'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.421460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e94825f5b9e4951b35abafd9443c222'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.433905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1183/2370] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:47 2022] DELETE /identity/v3/users/7e94825f5b9e4951b35abafd9443c222 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:47.692168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:47.711837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399506f-fc3f-4a8a-b569-f91ded7f3c41 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:47.770047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:47.770681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:47.770963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:47.771237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] PATH_INFO: `/v3/projects/0dfc28ddbf6c4fbfa95fba25bdd5686d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:47.775442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfc28ddbf6c4fbfa95fba25bdd5686d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:47.777617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:47.788517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:47.834560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfc28ddbf6c4fbfa95fba25bdd5686d', 'request_id': 'req-de290568-ecf4-4146-afbe-0a43565c810d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.843106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfc28ddbf6c4fbfa95fba25bdd5686d', 'request_id': 'req-de290568-ecf4-4146-afbe-0a43565c810d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.850041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfc28ddbf6c4fbfa95fba25bdd5686d', 'request_id': 'req-de290568-ecf4-4146-afbe-0a43565c810d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.861388 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] The token cache is being invalidate because project 0dfc28ddbf6c4fbfa95fba25bdd5686d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:47.861616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.862329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.864181 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1188/2371] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:47 2022] DELETE /identity/v3/projects/0dfc28ddbf6c4fbfa95fba25bdd5686d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:47.868308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:47.869718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:47.883038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59496638-0552-444e-a737-98616d87d1da admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:47.938326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:47.938954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:47.939238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:47.939512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] PATH_INFO: `/v3/users/ef43a37bbbff4b86af96ae38122c5ea2` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:47.940620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef43a37bbbff4b86af96ae38122c5ea2)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:47.942563 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:47.987748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef43a37bbbff4b86af96ae38122c5ea2'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.988392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef43a37bbbff4b86af96ae38122c5ea2'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:47.995353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef43a37bbbff4b86af96ae38122c5ea2'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.007567 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef43a37bbbff4b86af96ae38122c5ea2'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.008198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9af0e47a-fd43-48b5-8f10-654267587508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef43a37bbbff4b86af96ae38122c5ea2'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.020834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1184/2372] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:47 2022] DELETE /identity/v3/users/ef43a37bbbff4b86af96ae38122c5ea2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:48.188015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.189448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.203995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de290568-ecf4-4146-afbe-0a43565c810d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.261101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.261722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.262029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.262301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] PATH_INFO: `/v3/projects/b160471fce5341e99e21bff678f8a157` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.264039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b160471fce5341e99e21bff678f8a157)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.265961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.313532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b160471fce5341e99e21bff678f8a157', 'request_id': 'req-15a6df35-dd4a-4f94-8646-b0713dc4acac'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.322246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b160471fce5341e99e21bff678f8a157', 'request_id': 'req-15a6df35-dd4a-4f94-8646-b0713dc4acac'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.329811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b160471fce5341e99e21bff678f8a157', 'request_id': 'req-15a6df35-dd4a-4f94-8646-b0713dc4acac'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.340298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] The token cache is being invalidate because project b160471fce5341e99e21bff678f8a157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:48.340582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.341275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15a6df35-dd4a-4f94-8646-b0713dc4acac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:48.342840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1189/2373] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:48 2022] DELETE /identity/v3/projects/b160471fce5341e99e21bff678f8a157 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:48.347810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.348272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.348411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.367799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:48.368935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.416428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:48.430832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1185/2374] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:48.439275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.439580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.439856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.460494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:48.461711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.469645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1190/2375] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:48.473909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.484142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd6549-ff41-498c-b2b2-ea9855540b78 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.488803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.489401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.489683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.489982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.490658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:47:48.490964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.492557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.504655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1186/2376] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:47:48.508700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.517835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e26db-ad9f-4170-8787-53343a24ea9f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.522418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.522999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.523275 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.523541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.524167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.526109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.541715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:48.555260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1191/2377] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:48.559230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.569822 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bc08d-5e27-422c-834a-3f46a7e85b36 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.646340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.646861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.647139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.647411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.648050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.649974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.671490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1187/2378] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:48.675603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.686692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fed63-1509-4bb5-bbee-fdeb6da46f49 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.691172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.691758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.692038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.692306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.692940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.694546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.705280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1192/2379] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:48.707270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.709111 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.709253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.719445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242115-6024-4b69-bd8c-63e3c54ff8f6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.724604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.725203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.725484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.725754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.726498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.728088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.739552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1193/2380] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:48.744488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.759433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0939-d74f-419d-b4c5-7b75e90c160a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.767122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.767949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.768238 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.768506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] PATH_INFO: `/v3/projects/93a170ba31ca4e29be0c5890ebd3187d/users/81e43dceb91a46529db71a8257f0d35c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.786023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a170ba31ca4e29be0c5890ebd3187d, user_id=81e43dceb91a46529db71a8257f0d35c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.788748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec81c-62d8-467a-8ad0-9c99cd4110b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.789333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9a05-27d8-4b41-a5bb-fbf3c0a173fd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.796391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:48.797669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.798406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.798851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.801144 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.804574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1194/2381] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:48 2022] PUT /identity/v3/projects/93a170ba31ca4e29be0c5890ebd3187d/users/81e43dceb91a46529db71a8257f0d35c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:48.815997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:48.816183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:48.816444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:48.845239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] MFA Rules not processed for user `81e43dceb91a46529db71a8257f0d35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:48.846487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:48.877262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:48.878936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:48.892311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1188/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:47:48.927491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1195/2383] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:47:48.932385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:48.945885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41263e-6269-4164-8d42-6030ab6defc3 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:48.950868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:49.023980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.024824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.025101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.025718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.026216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.029078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.066919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1189/2384] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:48 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:47:49.068066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.086224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83372-2fbc-41d3-b7d8-699038f937c4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.161039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.162130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.162130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.162130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.162757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.164678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.187655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1196/2385] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:49 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:47:49.191820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.203258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea1a9-8400-4803-ba52-93e55df9d158 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.209167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.209799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.210126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.210406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.211114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.212730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.227705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1190/2386] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:49.231985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.243576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a4de6-5a3c-4770-8898-caa697d5abfc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.249004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.249753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.250552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.251102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] PATH_INFO: `/v3/projects/a6d465add2524b699d462f0b024e48af/users/a66ab1513bc84290895c909458dde63c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.272006 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d465add2524b699d462f0b024e48af, user_id=a66ab1513bc84290895c909458dde63c, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.274779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.290303 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1197/2387] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:49 2022] PUT /identity/v3/projects/a6d465add2524b699d462f0b024e48af/users/a66ab1513bc84290895c909458dde63c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:49.298532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.311525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9012-96bd-4d9a-b84d-792fd485b8bb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.369676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.370402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.370587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.370861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.371496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.373132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c694f64-6910-4b9d-a95f-f2b2e6180d12 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.383274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1191/2388] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:49.387494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.395482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:49.399857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0674-e068-4533-afbe-9e51622a5457 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.406501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.407319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.407602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.407877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] PATH_INFO: `/v3/projects/a6d465add2524b699d462f0b024e48af/users/a66ab1513bc84290895c909458dde63c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.410206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d465add2524b699d462f0b024e48af, user_id=a66ab1513bc84290895c909458dde63c, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.412917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.423980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1198/2389] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:49 2022] PUT /identity/v3/projects/a6d465add2524b699d462f0b024e48af/users/a66ab1513bc84290895c909458dde63c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:49.435668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918521d-6194-4c59-84d1-68599312a76c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.436648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918521d-6194-4c59-84d1-68599312a76c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.436937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918521d-6194-4c59-84d1-68599312a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.466731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5918521d-6194-4c59-84d1-68599312a76c None None] MFA Rules not processed for user `a66ab1513bc84290895c909458dde63c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:49.467983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5918521d-6194-4c59-84d1-68599312a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:49.537264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1192/2390] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:47:49.548989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:49.550702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:49.607878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346bf5-8027-49ce-9507-535cf5539693 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:49.611541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:49.612145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:49.612422 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:49.612693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:49.621541 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:49.623535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238a84-7f91-4098-846b-0043d8429cfa service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:49.632799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1199/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:50.046208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918521d-6194-4c59-84d1-68599312a76c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:50.050410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:50.109425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918521d-6194-4c59-84d1-68599312a76c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:50.114048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:50.114680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.115018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.115225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] PATH_INFO: `/v3/users/81e43dceb91a46529db71a8257f0d35c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.116455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e43dceb91a46529db71a8257f0d35c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:50.118396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:50.167260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e43dceb91a46529db71a8257f0d35c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.168067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e43dceb91a46529db71a8257f0d35c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.175510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e43dceb91a46529db71a8257f0d35c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.188711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e43dceb91a46529db71a8257f0d35c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.189411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e43dceb91a46529db71a8257f0d35c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.204130 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1193/2392] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:50 2022] DELETE /identity/v3/users/81e43dceb91a46529db71a8257f0d35c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:50.208966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.209445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.209788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.228815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:50.230081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.293127 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1200/2393] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:50.303864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:50.305293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.363735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ba522-d39d-4257-b7c9-27ca41c10a6e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:50.367420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:50.368039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.368318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.368592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.378422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:50.380069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0c1f7-da5b-47c3-a02e-e53240aa4ad7 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:50.390694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1194/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:50.671248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:50.673531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.699290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e7ef-3ca1-4672-b4ff-6172978e5e03 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:50.704443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:50.705103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.705504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.705864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] PATH_INFO: `/v3/projects/93a170ba31ca4e29be0c5890ebd3187d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.707180 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a170ba31ca4e29be0c5890ebd3187d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:50.709196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:50.725593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18395b-7077-4780-9be0-09849f208018 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.725887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18395b-7077-4780-9be0-09849f208018 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.726212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18395b-7077-4780-9be0-09849f208018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.750486 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0b18395b-7077-4780-9be0-09849f208018 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:50.751798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0b18395b-7077-4780-9be0-09849f208018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.767427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a170ba31ca4e29be0c5890ebd3187d', 'request_id': 'req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.773826 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:50.776957 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a170ba31ca4e29be0c5890ebd3187d', 'request_id': 'req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.788916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a170ba31ca4e29be0c5890ebd3187d', 'request_id': 'req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.803879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] The token cache is being invalidate because project 93a170ba31ca4e29be0c5890ebd3187d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:50.804488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.805348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.807134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1201/2395] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:50 2022] DELETE /identity/v3/projects/93a170ba31ca4e29be0c5890ebd3187d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:50.811494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:50.812829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.818121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1195/2396] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:47:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:50.833243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18395b-7077-4780-9be0-09849f208018 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:50.834162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:50.835945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0b18395b-7077-4780-9be0-09849f208018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:50.891430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfe4e7-1840-41e2-8cad-56d4130ce08f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:50.896206 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:50.896943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.897231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.897506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] PATH_INFO: `/v3/users/a66ab1513bc84290895c909458dde63c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.899685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66ab1513bc84290895c909458dde63c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:50.901688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:50.915414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18395b-7077-4780-9be0-09849f208018 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:50.923671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:50.924363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:50.924711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:50.925059 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:50.935482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:50.936309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:50.946843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1196/2397] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:47:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:47:50.956514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66ab1513bc84290895c909458dde63c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.957195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66ab1513bc84290895c909458dde63c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.964847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66ab1513bc84290895c909458dde63c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.982465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66ab1513bc84290895c909458dde63c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:50.983531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-565f52df-ffe1-4d52-b830-85de223b42eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66ab1513bc84290895c909458dde63c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.001317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1202/2398] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:50 2022] DELETE /identity/v3/users/a66ab1513bc84290895c909458dde63c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:51.354456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:51.372557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4331aea-c598-4428-b0f4-852bde37b077 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:51.464583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:51.465689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.466054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.466474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] PATH_INFO: `/v3/projects/a6d465add2524b699d462f0b024e48af` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.467957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d465add2524b699d462f0b024e48af)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:51.469875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:51.551434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d465add2524b699d462f0b024e48af', 'request_id': 'req-f3b81d09-9f65-49bc-8bc4-503eb1d41369'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.562152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d465add2524b699d462f0b024e48af', 'request_id': 'req-f3b81d09-9f65-49bc-8bc4-503eb1d41369'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.571346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d465add2524b699d462f0b024e48af', 'request_id': 'req-f3b81d09-9f65-49bc-8bc4-503eb1d41369'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.576889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:51.594131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] The token cache is being invalidate because project a6d465add2524b699d462f0b024e48af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:51.596104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.596837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f3b81d09-9f65-49bc-8bc4-503eb1d41369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:51.598673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1197/2399] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:51 2022] DELETE /identity/v3/projects/a6d465add2524b699d462f0b024e48af => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:51.603354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.603822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.603963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.631404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:51.632622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:51.704939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1203/2400] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:47:51.715046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.715368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.715681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.743403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:51.745494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:51.755599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1198/2401] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:51.759697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:51.772588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c8ec-3f3d-4158-9e9d-3c89a60eb566 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:51.777836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:51.779214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.779514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.779824 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.789647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:47:51.789979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:51.791618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:51.815979 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1204/2402] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:47:51.816975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:51.832797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fe7e3-c477-42be-ba48-109752fb6dd4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:51.839015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:51.841865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.842299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.842655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.843379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:51.847404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:51.886618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:51.893426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1199/2403] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:51 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:51.897126 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e719c0-e03d-491e-b4b2-60d150e502c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:51.927448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:51.980113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:51.980966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:51.981980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:51.982573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:51.983254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:51.991093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.021654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1205/2404] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:51 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:52.026140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.039082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49300b30-1dba-484f-9af6-1a30fbfd7594 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.045081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.045820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.046229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.046604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.047496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.051479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.065984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1200/2405] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:52.071099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.088355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b78c-34a7-40c4-952d-b24dde659110 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.098380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.099706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.099994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.100270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.100928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.103257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2963-bf9a-4992-80e8-d0e86255dd3a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.118327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1206/2406] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:52.122825 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.135884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73345d36-53de-4361-bec4-1613eeb39c82 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.141239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.141901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.142398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.142683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] PATH_INFO: `/v3/projects/07841dd95fb44565bf7a3b82752ee63e/users/676981feed744fc9bcb62cc832333792/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.163936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07841dd95fb44565bf7a3b82752ee63e, user_id=676981feed744fc9bcb62cc832333792, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.166635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.187297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1201/2407] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:52 2022] PUT /identity/v3/projects/07841dd95fb44565bf7a3b82752ee63e/users/676981feed744fc9bcb62cc832333792/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:52.198226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.198575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.198779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.236263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] MFA Rules not processed for user `676981feed744fc9bcb62cc832333792`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:52.237517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:52.356444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1207/2408] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:52.358439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.458713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21992-e87f-4780-aea6-a8e82ee9a966 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.463903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.464599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.465146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.465303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.466213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.468133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.508410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1202/2409] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:52 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:52.510678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.522607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa454cb-c9a5-4f10-bc7b-36ff451ad5e7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.620706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.621503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.623659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.623659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.623659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.625203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.651774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1208/2410] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:52 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:52.656227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.671726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca83c2-c6c5-4e9d-b840-f8153631e118 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.677784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.678500 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.678850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.679191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.680131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.681804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.697668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1203/2411] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:52.702588 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.717690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba03ab-c5cc-428e-b6f0-2bef59d4b893 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.722796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.723490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.723861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.724208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] PATH_INFO: `/v3/projects/b6aabf1c616b42a49680ef08accb4b51/users/8678b042088048c69c8e0476beb5a4f8/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.746642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6aabf1c616b42a49680ef08accb4b51, user_id=8678b042088048c69c8e0476beb5a4f8, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.750217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.759230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:52.766939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1209/2412] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:52 2022] PUT /identity/v3/projects/b6aabf1c616b42a49680ef08accb4b51/users/8678b042088048c69c8e0476beb5a4f8/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:52.771213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.796064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bca013-c01c-4cf4-8387-5ef933dd983f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.896903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.897530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.897812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.898207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.899022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.900757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca06a8-293f-4240-8705-2bc6ceec5231 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.908750 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:52.924929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:52.927334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1204/2413] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:52.940282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1c4e5-bb46-4762-b805-db4e6f0a3d88 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:52.947726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:52.948428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.948708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.948980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] PATH_INFO: `/v3/projects/b6aabf1c616b42a49680ef08accb4b51/users/8678b042088048c69c8e0476beb5a4f8/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:52.951556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6aabf1c616b42a49680ef08accb4b51, user_id=8678b042088048c69c8e0476beb5a4f8, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:52.954298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:52.965883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1210/2414] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:52 2022] PUT /identity/v3/projects/b6aabf1c616b42a49680ef08accb4b51/users/8678b042088048c69c8e0476beb5a4f8/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:52.979594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:52.980019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:52.980392 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:53.021923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] MFA Rules not processed for user `8678b042088048c69c8e0476beb5a4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:53.023426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:53.104188 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1205/2415] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:53.116702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:53.118506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:53.197144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846236a-6806-46de-a6b6-e671ad8c3f35 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:53.201543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:53.202293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:53.202579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:53.202860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:53.216075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:53.217537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7308a-893f-4b78-861f-38afe16f5004 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:53.229809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1211/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:53.264842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:53.354411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc41c-aff7-495d-a84a-65e35c9ff253 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:53.360470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:53.361122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:53.361404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:53.361679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] PATH_INFO: `/v3/users/676981feed744fc9bcb62cc832333792` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:53.362873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=676981feed744fc9bcb62cc832333792)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:53.364832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:53.472371 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676981feed744fc9bcb62cc832333792'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:53.474089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676981feed744fc9bcb62cc832333792'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:53.486604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676981feed744fc9bcb62cc832333792'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:53.501632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676981feed744fc9bcb62cc832333792'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:53.502673 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676981feed744fc9bcb62cc832333792'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:53.519348 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:53.530367 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1206/2417] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:53 2022] DELETE /identity/v3/users/676981feed744fc9bcb62cc832333792 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:53.535448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:53.535900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:53.536316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:53.566321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:53.567608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:53.658492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1212/2418] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:53.664213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:53.666410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:53.759476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325bfd6-d74c-4d7b-92c5-601f7dd4a95c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:53.774997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:53.775631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:53.775921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:53.776197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:53.787258 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:53.788412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:53.812840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1207/2419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:54.340130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:54.342614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:54.362009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39b8fb-f924-45e2-af80-b1430096924b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:54.367500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:54.368247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:54.368528 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:54.368797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] PATH_INFO: `/v3/projects/07841dd95fb44565bf7a3b82752ee63e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:54.369929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07841dd95fb44565bf7a3b82752ee63e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:54.371873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:54.448700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07841dd95fb44565bf7a3b82752ee63e', 'request_id': 'req-185fc32a-46cd-41b6-a1b8-d291965adc45'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.458406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07841dd95fb44565bf7a3b82752ee63e', 'request_id': 'req-185fc32a-46cd-41b6-a1b8-d291965adc45'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.465664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07841dd95fb44565bf7a3b82752ee63e', 'request_id': 'req-185fc32a-46cd-41b6-a1b8-d291965adc45'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.486248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] The token cache is being invalidate because project 07841dd95fb44565bf7a3b82752ee63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:54.486612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.487306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.494595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1213/2420] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:54 2022] DELETE /identity/v3/projects/07841dd95fb44565bf7a3b82752ee63e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:54.496273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:54.511773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b067c9-0284-473f-9b19-c11f6e1ae4d4 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:54.626857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:54.627527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:54.627807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:54.628089 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] PATH_INFO: `/v3/users/8678b042088048c69c8e0476beb5a4f8` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:54.629414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8678b042088048c69c8e0476beb5a4f8)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:54.631474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:54.703844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8678b042088048c69c8e0476beb5a4f8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.708933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8678b042088048c69c8e0476beb5a4f8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.729959 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8678b042088048c69c8e0476beb5a4f8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.770875 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8678b042088048c69c8e0476beb5a4f8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.771628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f873005-e59d-44e1-8d43-e4bc4ceb670b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8678b042088048c69c8e0476beb5a4f8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:54.790029 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1208/2421] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:47:54 2022] DELETE /identity/v3/users/8678b042088048c69c8e0476beb5a4f8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:55.129266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.131476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:55.150870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fc32a-46cd-41b6-a1b8-d291965adc45 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.166279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:55.232073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.232999 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.233386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.233671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] PATH_INFO: `/v3/projects/b6aabf1c616b42a49680ef08accb4b51` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.235010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6aabf1c616b42a49680ef08accb4b51)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.236942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.314685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6aabf1c616b42a49680ef08accb4b51', 'request_id': 'req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:55.326382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6aabf1c616b42a49680ef08accb4b51', 'request_id': 'req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:55.335744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6aabf1c616b42a49680ef08accb4b51', 'request_id': 'req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:55.348046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] The token cache is being invalidate because project b6aabf1c616b42a49680ef08accb4b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:47:55.348419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:55.349245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecfaa6af-6957-495c-a3c3-87ceeafaaa96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:47:55.354624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1214/2422] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:47:55 2022] DELETE /identity/v3/projects/b6aabf1c616b42a49680ef08accb4b51 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:55.356110 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.356436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.356718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.384031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:55.385309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:55.410016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:55.469391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1209/2423] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:47:55.478776 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.479056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.479331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.506045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:55.507534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:55.518939 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1215/2424] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:55.535759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.549663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a8cef-d233-4fe9-8816-9ef838935d87 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.554370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.554985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.555282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.555561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.556208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:47:55.556508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.558262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.576069 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.580754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1210/2425] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:47:55.586290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a05181-7394-4a3f-ac7d-ba6cc4a9c196 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.592608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.593250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.593532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.593890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.594557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.596489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.635352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1216/2426] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:55 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:55.640714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.651264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b208f-2cf1-4eaf-a13d-6a272a82984d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.728214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.728950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.729383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.729663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.730331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.732475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.758537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1211/2427] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:55 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:55.763362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.777856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d430c1-149f-4b66-9442-c384ea8980bd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.783196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.783807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.784480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.784702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.785348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.786913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.802028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.802678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1217/2428] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:55.815437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b4d1-ea6e-4a84-85c7-82a423f2ff79 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.820040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.820656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.821455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.821455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.821844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.823475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac129585-bb64-4f96-92b1-d5ace7e18645 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.839620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:55.839838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1212/2429] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:55.852785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27690b0-db42-4977-9e41-b004e1cd5a71 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:55.860442 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:55.860573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.860954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.861373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] PATH_INFO: `/v3/projects/47333a276eab4af3b56f05acc1454bdd/users/599fbc69568a43008dc47358b5264c21/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.887481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=47333a276eab4af3b56f05acc1454bdd, user_id=599fbc69568a43008dc47358b5264c21, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:55.891037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:55.906322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1218/2430] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:55 2022] PUT /identity/v3/projects/47333a276eab4af3b56f05acc1454bdd/users/599fbc69568a43008dc47358b5264c21/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:55.920297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:55.920593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:55.920868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:55.950816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] MFA Rules not processed for user `599fbc69568a43008dc47358b5264c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:55.952065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:56.026660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1213/2431] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:56.027890 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.078239 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:56.104065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940d4c-d382-4101-b3c2-572cdc0fc6df admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.111323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.111940 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.112226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.112504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.113169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.115182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.151245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1219/2432] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:56 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:56.152373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.164502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4688-d767-4cf4-be86-23c97983acaf None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.179707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:56.233906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.234557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.234841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.235121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.235761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.237717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.277098 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1214/2433] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:56 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:47:56.285159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.305034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120b782-40ba-4191-8417-4e1d5575e5d3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.310284 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.310931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.311214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.311488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.313005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.314804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.331809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1220/2434] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:56.336726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.351027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0746-cfab-4a96-9f5a-7ff7b9c04e78 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.357088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.357706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.358023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.358310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.358960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.360615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce739c14-e730-48d0-b972-e9adafdedc3d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.377993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1215/2435] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:47:56.380110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.390867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c11-14bf-494e-81c6-5eac960911da admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.396017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.396674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.396962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.397243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] PATH_INFO: `/v3/projects/d3d1c9e1970c46008a05d30354a2639f/users/a0de4b1300d74f5fb041ca7093d6a9d0/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.417978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d1c9e1970c46008a05d30354a2639f, user_id=a0de4b1300d74f5fb041ca7093d6a9d0, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.421273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.446964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1221/2436] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:56 2022] PUT /identity/v3/projects/d3d1c9e1970c46008a05d30354a2639f/users/a0de4b1300d74f5fb041ca7093d6a9d0/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:47:56.452200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.452200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.452200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.486310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] MFA Rules not processed for user `a0de4b1300d74f5fb041ca7093d6a9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:56.487741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:56.566430 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1216/2437] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:56.572935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.690229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540724-4c6e-448a-93cd-a4720f753793 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.695424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.696047 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.696331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.696637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.697277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.701261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.738042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1222/2438] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:47:56 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:47:56.741436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.756534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170c86f-b690-4832-a96c-132ba3811b5c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.831418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.832107 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.832391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.832663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.833309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.835511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.868614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1217/2439] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:47:56 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:47:56.869740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.882555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f7e9-179e-437f-b4b2-b88cd722149f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.888542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.889263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.889668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.890080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.890839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.892597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.910185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1223/2440] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:56.913988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.926867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2ff1-c733-4ba0-8c65-4d4a6ba5e1c6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:56.931690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:56.932374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:56.932642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:56.933036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] PATH_INFO: `/v3/projects/4a224fa276e64e83acdeccb969146414/users/c88850fb05be40f483107a8427bae5e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:56.948660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:56.953753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a224fa276e64e83acdeccb969146414, user_id=c88850fb05be40f483107a8427bae5e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:56.956937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:56.975424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1218/2441] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:56 2022] PUT /identity/v3/projects/4a224fa276e64e83acdeccb969146414/users/c88850fb05be40f483107a8427bae5e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:56.983242 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:56.994755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84455c0-7adb-4c37-a0b4-d2169e9d8e3e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:57.062692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:57.063420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:57.063760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:57.064097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:57.064802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:57.066490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5762d5-2834-4ad2-9c5a-704dfcc29d05 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:57.069434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:47:57.084081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1224/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:47:57.085321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:57.098298 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd58fd-5540-4669-9762-078663077ed1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:57.102935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:57.103581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:57.103859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:57.104131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] PATH_INFO: `/v3/projects/4a224fa276e64e83acdeccb969146414/users/c88850fb05be40f483107a8427bae5e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:57.106023 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a224fa276e64e83acdeccb969146414, user_id=c88850fb05be40f483107a8427bae5e1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:57.110585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:57.132375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1219/2443] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:47:57 2022] PUT /identity/v3/projects/4a224fa276e64e83acdeccb969146414/users/c88850fb05be40f483107a8427bae5e1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:47:57.135228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:57.135516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:57.135808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:57.167995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] MFA Rules not processed for user `c88850fb05be40f483107a8427bae5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:47:57.170358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:57.248052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1225/2444] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:47:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:47:57.261036 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:57.264263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:57.359773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a604-3c40-4a2c-897a-a38c59d2fe54 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:57.364236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:57.364944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:57.365290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:57.365628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:57.375657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:57.377114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:57.389299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1220/2445] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:47:58.037336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:47:58.038982 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:47:58.051726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94966847-e23d-4da5-bdbe-61a0009588f3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:47:58.055972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:47:58.056673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:47:58.056977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:47:58.057293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:47:58.119854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:47:58.121733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:47:58.133520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1226/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:47:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:01.690785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:01.692692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:01.766865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34c37d-7bfe-4d81-a77a-266efd4c8f61 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:01.772293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:01.772896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:01.773181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:01.773456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:01.775190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:01.809701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:01.811171 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:01.842741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:01.844434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:01.853692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1221/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:01.871315 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad0f8-13ea-44e9-9004-225f876c855f service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:01.875010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:01.875613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:01.875896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:01.876172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:01.877995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:01.888197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:01.889610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:01.897917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1227/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:02.349331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:02.359198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08c9c-512c-4f99-953b-42cf749b6e2f service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:02.362805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:02.363405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:02.363691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:02.363967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:02.376913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:02.430686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:02.432120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4c99-56e6-4084-be5c-f632871f969d service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:02.441485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1222/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:04.646577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:04.677152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:04.714102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc982b-19da-4bd8-ba06-821b31380fce service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:04.719045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:04.719661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:04.719945 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:04.720222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] PATH_INFO: `/v3/users/599fbc69568a43008dc47358b5264c21` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:04.721340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599fbc69568a43008dc47358b5264c21)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:04.723293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:04.768597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599fbc69568a43008dc47358b5264c21'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:04.769246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599fbc69568a43008dc47358b5264c21'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:04.776638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599fbc69568a43008dc47358b5264c21'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:04.790699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599fbc69568a43008dc47358b5264c21'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:04.791418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599fbc69568a43008dc47358b5264c21'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:04.805732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1228/2450] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:04 2022] DELETE /identity/v3/users/599fbc69568a43008dc47358b5264c21 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:04.810831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:04.811369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:04.811369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:04.831198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:04.832414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:04.895970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1223/2451] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:04.907888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:04.910042 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:04.973129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80367410-134b-4301-bba5-9a5413a3ae46 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:04.976721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:04.977317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:04.977595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:04.977865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:04.987164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:04.988574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:04.998429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1229/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:05.283343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:05.285116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:05.297641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249d8e-b159-4963-a62c-54dcd9f2744e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:05.303006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:05.304416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:05.304882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:05.305166 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] PATH_INFO: `/v3/projects/47333a276eab4af3b56f05acc1454bdd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:05.306352 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47333a276eab4af3b56f05acc1454bdd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:05.308957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:05.362914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47333a276eab4af3b56f05acc1454bdd', 'request_id': 'req-bb45a2d4-be55-4b09-8928-ec716ccec419'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.370742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47333a276eab4af3b56f05acc1454bdd', 'request_id': 'req-bb45a2d4-be55-4b09-8928-ec716ccec419'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.377274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47333a276eab4af3b56f05acc1454bdd', 'request_id': 'req-bb45a2d4-be55-4b09-8928-ec716ccec419'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.387978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] The token cache is being invalidate because project 47333a276eab4af3b56f05acc1454bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:05.388206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.388846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.390394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1224/2453] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:05 2022] DELETE /identity/v3/projects/47333a276eab4af3b56f05acc1454bdd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:05.394413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:05.404665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f522d-d0b1-4d42-9175-56e91545c0b3 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:05.449656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:05.465007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:05.465669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:05.466678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:05.466916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] PATH_INFO: `/v3/users/a0de4b1300d74f5fb041ca7093d6a9d0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:05.468214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0de4b1300d74f5fb041ca7093d6a9d0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:05.470176 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:05.527131 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0de4b1300d74f5fb041ca7093d6a9d0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.527926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0de4b1300d74f5fb041ca7093d6a9d0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.536566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0de4b1300d74f5fb041ca7093d6a9d0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.551379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0de4b1300d74f5fb041ca7093d6a9d0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.552465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0de4b1300d74f5fb041ca7093d6a9d0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.566247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1230/2454] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:05 2022] DELETE /identity/v3/users/a0de4b1300d74f5fb041ca7093d6a9d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:05.849539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:05.851631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:05.866300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45a2d4-be55-4b09-8928-ec716ccec419 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:05.910819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:05.936140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:05.936805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:05.937054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:05.937323 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] PATH_INFO: `/v3/projects/d3d1c9e1970c46008a05d30354a2639f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:05.938629 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d1c9e1970c46008a05d30354a2639f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:05.940581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:05.986997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d1c9e1970c46008a05d30354a2639f', 'request_id': 'req-a5dd2600-218b-4d8f-a3a1-8332da77f149'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:05.995449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d1c9e1970c46008a05d30354a2639f', 'request_id': 'req-a5dd2600-218b-4d8f-a3a1-8332da77f149'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.002680 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d1c9e1970c46008a05d30354a2639f', 'request_id': 'req-a5dd2600-218b-4d8f-a3a1-8332da77f149'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.013261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] The token cache is being invalidate because project d3d1c9e1970c46008a05d30354a2639f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:06.013551 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.014244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.015721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1225/2455] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:05 2022] DELETE /identity/v3/projects/d3d1c9e1970c46008a05d30354a2639f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:06.019739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.021194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.035085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dd6a-eed1-4ab5-8758-1b1ae720a591 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:06.097280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:06.097910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.098218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.098492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] PATH_INFO: `/v3/users/c88850fb05be40f483107a8427bae5e1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.099593 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88850fb05be40f483107a8427bae5e1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:06.101515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:06.151196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88850fb05be40f483107a8427bae5e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.151920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88850fb05be40f483107a8427bae5e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.160183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88850fb05be40f483107a8427bae5e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.167963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:06.173447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88850fb05be40f483107a8427bae5e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.174245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33e84956-4509-47bb-a751-8bc3f420328e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88850fb05be40f483107a8427bae5e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.188145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1231/2456] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:06 2022] DELETE /identity/v3/users/c88850fb05be40f483107a8427bae5e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:06.483970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.485512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.519327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2600-218b-4d8f-a3a1-8332da77f149 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:06.585622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45993255-6499-4608-bbab-78458582635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:06.586364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993255-6499-4608-bbab-78458582635e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.586713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993255-6499-4608-bbab-78458582635e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.587052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45993255-6499-4608-bbab-78458582635e admin admin] PATH_INFO: `/v3/projects/4a224fa276e64e83acdeccb969146414` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.588267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45993255-6499-4608-bbab-78458582635e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a224fa276e64e83acdeccb969146414)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:06.590249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45993255-6499-4608-bbab-78458582635e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:06.642582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a224fa276e64e83acdeccb969146414', 'request_id': 'req-45993255-6499-4608-bbab-78458582635e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.663676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a224fa276e64e83acdeccb969146414', 'request_id': 'req-45993255-6499-4608-bbab-78458582635e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.674440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a224fa276e64e83acdeccb969146414', 'request_id': 'req-45993255-6499-4608-bbab-78458582635e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.685456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f1cd4-9b0e-4cd8-88d1-200f7d66d70e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.686103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f1cd4-9b0e-4cd8-88d1-200f7d66d70e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.686792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f1cd4-9b0e-4cd8-88d1-200f7d66d70e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.689095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1232/2457] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:48:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:48:06.689659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:06.692390 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] The token cache is being invalidate because project 4a224fa276e64e83acdeccb969146414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:06.692773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.693990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-45993255-6499-4608-bbab-78458582635e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:06.695297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.695992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.696249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1226/2458] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:06 2022] DELETE /identity/v3/projects/4a224fa276e64e83acdeccb969146414 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:06.696657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.702756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2108-2fda-47d3-b8af-546c484ae46b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.703178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2108-2fda-47d3-b8af-546c484ae46b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.703688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f2108-2fda-47d3-b8af-546c484ae46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.721166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:06.722514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.725234 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-231f2108-2fda-47d3-b8af-546c484ae46b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:06.726452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-231f2108-2fda-47d3-b8af-546c484ae46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.793416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1227/2459] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:06.802318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.802605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.802884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.808499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1233/2460] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:48:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:06.822799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.824677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.826975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:06.828538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:06.841689 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1228/2461] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:06.845718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.855988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de889-354e-4a70-a19e-6380acf181ed None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:06.861872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:06.862645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.862996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.863438 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.864192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:06.864686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:06.866622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:06.889189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1229/2462] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:06.893459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.902281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdf5c-5326-40cc-b8be-522fcd186fbe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:06.906172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f2a7-5f71-414a-8cb6-895809df979f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:06.907087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a9468ff5431e972345db08ac876d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:06.907812 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.908191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.908669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.915995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:06.916626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:06.916890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:06.917159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:06.917801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:06.920272 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfd148-906f-42cd-bce6-0ce2205217ad admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:06.923677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:06.925340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:06.939486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1234/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:06.967416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1230/2464] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:06 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:06.971162 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:06.983241 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f7a84-3ab6-47e9-a848-e08476daea57 service glance] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.029243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af133-49a1-4a9e-b112-147c915374aa None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.029639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af133-49a1-4a9e-b112-147c915374aa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.030305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af133-49a1-4a9e-b112-147c915374aa None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.031923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1231/2465] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 18:48:07.037112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.037399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.037687 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.065966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.067664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.067959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.068414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.068988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.071080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.071799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] MFA Rules not processed for user `5cef70055b3f49ed9a1aabd221877bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:07.073184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.097983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1235/2466] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:06 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:07.101386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.112740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0cf6-e1e3-43a5-9f0a-fd074713f9b9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.117619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.118306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.118718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.119002 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.119673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.121261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.123503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:07.130310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1232/2467] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:07.133551 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1236/2468] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:07.137137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.142856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.145449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.148816 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79323-45f6-490c-bf95-789d52302dc7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.153877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.154520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.154802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.155074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.155711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.157286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.158844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ef513-d387-4214-b0f8-9f37dbceb1ba admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.162748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.163419 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.163691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.163968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.168157 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1233/2469] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:07.172271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.172688 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.174267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2155-96b8-4357-9560-fc00e6404bda service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.182180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994db0c-fcb9-4f9b-9cd7-4c60e65b9ca1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.183125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1237/2470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:07.188241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.189028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.189381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.189781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] PATH_INFO: `/v3/projects/343aaf1785c74fe79ac2c8adfad5efd7/users/af756594ebe84e8badf4cb3a2a381aa3/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.206700 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343aaf1785c74fe79ac2c8adfad5efd7, user_id=af756594ebe84e8badf4cb3a2a381aa3, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.209422 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eafd05-8732-4cb2-b4c2-2d4c8b85e974 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.224001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1234/2471] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:07 2022] PUT /identity/v3/projects/343aaf1785c74fe79ac2c8adfad5efd7/users/af756594ebe84e8badf4cb3a2a381aa3/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:07.235406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.235712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.235963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.266215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] MFA Rules not processed for user `af756594ebe84e8badf4cb3a2a381aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:07.267426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.278054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e921a-58a7-4670-a59a-c3b556b4d874 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.278404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e921a-58a7-4670-a59a-c3b556b4d874 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.279175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e921a-58a7-4670-a59a-c3b556b4d874 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.280765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1235/2472] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 8 18:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 18:48:07.290331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.291240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.291518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.313265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] MFA Rules not processed for user `b1c4541fb9874e818b90fba97a1fdb20`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:07.314711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.342414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1238/2473] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:07.347086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.351928 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:07.397726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1236/2474] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:07.410623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.420972 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e11bc-1dcd-4b5e-b9b2-b3117738e732 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.426027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.426771 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.427139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.427483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.428188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.430212 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.466399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1239/2475] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:07.470467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.474980 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed3a85-9ac0-4315-bd1b-5c46523f9788 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.524080 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.524786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.525077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.525404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.535018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b80138-ae87-4d68-b8ef-da61ed32b6fd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.539882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.540509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.540788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.541062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.541686 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.543632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.551805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:07.570871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1240/2476] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:07.572005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.582243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cee9d-512a-46f5-a6a1-cc0575961011 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.587428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.588140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.588531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.588900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.589629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.591329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.594543 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.595973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.601308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1241/2477] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:07.605307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.607229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1237/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:07.615875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935b83-2663-47e0-b910-9de446248fa9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.621221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.621959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.622866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.623139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] PATH_INFO: `/v3/projects/57566e6c4d554183ae20227c243d5ef5/users/409c37435e864add8e474022d52551ee/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.639360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57566e6c4d554183ae20227c243d5ef5, user_id=409c37435e864add8e474022d52551ee, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.642036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.655039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1242/2479] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:07 2022] PUT /identity/v3/projects/57566e6c4d554183ae20227c243d5ef5/users/409c37435e864add8e474022d52551ee/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:07.659459 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.669621 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.671292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.671710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ea72-80ec-4d95-8d3a-9452d72d9e0d service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.695283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:07.735979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.736512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.736802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.737082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.737757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.739400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.744053 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d1e94-14ca-4c5d-bc7c-423e61b7317d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.749887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1238/2480] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:07.750294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.751009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.751298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.751577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.753385 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.753867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.765509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f8f4-9bbd-412f-a0d2-8329f194c193 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:07.765726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.767357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c864e-51ca-4375-ace4-ac7fc133126c service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.770350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:07.770985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.771268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.771550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] PATH_INFO: `/v3/projects/57566e6c4d554183ae20227c243d5ef5/users/409c37435e864add8e474022d52551ee/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.773877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57566e6c4d554183ae20227c243d5ef5, user_id=409c37435e864add8e474022d52551ee, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:07.776508 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:07.777490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1243/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:07.789317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1239/2482] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:07 2022] PUT /identity/v3/projects/57566e6c4d554183ae20227c243d5ef5/users/409c37435e864add8e474022d52551ee/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:07.857043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:07.857337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:07.857610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:07.890546 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] MFA Rules not processed for user `409c37435e864add8e474022d52551ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:07.891903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:07.965653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1244/2483] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:07.977165 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:07.979341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:08.038906 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c491-21b8-46aa-9f61-9674dc773743 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:08.042851 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:08.043461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:08.043738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:08.044497 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:08.053667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:08.055208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ed59-5021-44ec-8cb9-8c97ed3f19dd service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:08.065461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1240/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:08.215198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:08.255656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:08.301192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74469e-43a5-4b7c-819b-660c08e941ae None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:08.305899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:08.306557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:08.306835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:08.307104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] PATH_INFO: `/v3/users/af756594ebe84e8badf4cb3a2a381aa3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:08.308322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af756594ebe84e8badf4cb3a2a381aa3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:08.310732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:08.367484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af756594ebe84e8badf4cb3a2a381aa3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.368221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af756594ebe84e8badf4cb3a2a381aa3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.376039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af756594ebe84e8badf4cb3a2a381aa3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.389285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af756594ebe84e8badf4cb3a2a381aa3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.390054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af756594ebe84e8badf4cb3a2a381aa3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.416037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1245/2485] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:08 2022] DELETE /identity/v3/users/af756594ebe84e8badf4cb3a2a381aa3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:08.421547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:08.421881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:08.422180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:08.441898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:08.443201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:08.521876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1241/2486] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:08.532377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:08.534106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:08.595486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35748bcb-7abc-4afa-8a44-6445db04c36e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:08.599451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:08.600072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:08.600361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:08.600636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:08.610569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:08.612011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:08.621839 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1246/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:08.891218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:08.892650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:08.906204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871651e-9897-4405-a5f8-fb932c513280 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:08.911001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:08.912042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:08.912042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:08.912268 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] PATH_INFO: `/v3/projects/343aaf1785c74fe79ac2c8adfad5efd7` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:08.913441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=343aaf1785c74fe79ac2c8adfad5efd7)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:08.915364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:08.960830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:08.965286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343aaf1785c74fe79ac2c8adfad5efd7', 'request_id': 'req-99137292-9717-46d8-b40c-be3c549a0bdb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.974195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343aaf1785c74fe79ac2c8adfad5efd7', 'request_id': 'req-99137292-9717-46d8-b40c-be3c549a0bdb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.980437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343aaf1785c74fe79ac2c8adfad5efd7', 'request_id': 'req-99137292-9717-46d8-b40c-be3c549a0bdb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.991995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] The token cache is being invalidate because project 343aaf1785c74fe79ac2c8adfad5efd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:08.992505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.993507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:08.995944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1242/2488] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:08 2022] DELETE /identity/v3/projects/343aaf1785c74fe79ac2c8adfad5efd7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:09.000858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.010611 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c5ff-25d6-448b-8614-9cb6455e0663 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.061325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:09.071335 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.072147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.072639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.073119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] PATH_INFO: `/v3/users/409c37435e864add8e474022d52551ee` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.074323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409c37435e864add8e474022d52551ee)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.076892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.120744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409c37435e864add8e474022d52551ee'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.121387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409c37435e864add8e474022d52551ee'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.129090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409c37435e864add8e474022d52551ee'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.141602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409c37435e864add8e474022d52551ee'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.142272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a4bbb0e0-f042-4467-bdfe-a803cea20ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409c37435e864add8e474022d52551ee'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.155023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1247/2489] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:08 2022] DELETE /identity/v3/users/409c37435e864add8e474022d52551ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:09.459960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.461420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:09.474443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137292-9717-46d8-b40c-be3c549a0bdb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.530239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.530797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.531083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.531360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] PATH_INFO: `/v3/projects/57566e6c4d554183ae20227c243d5ef5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.532491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57566e6c4d554183ae20227c243d5ef5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.534451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.580186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57566e6c4d554183ae20227c243d5ef5', 'request_id': 'req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.587364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57566e6c4d554183ae20227c243d5ef5', 'request_id': 'req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.593425 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57566e6c4d554183ae20227c243d5ef5', 'request_id': 'req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.603472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] The token cache is being invalidate because project 57566e6c4d554183ae20227c243d5ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:09.603761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.604382 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b7c1ea75-ff60-4787-b8e8-bec4ac10099a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:09.605820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1243/2490] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:09 2022] DELETE /identity/v3/projects/57566e6c4d554183ae20227c243d5ef5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:09.611134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.611650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.611754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.632233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:09.633433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:09.693009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1248/2491] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:09.700739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.701339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.701623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.723024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:09.724251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:09.732798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1244/2492] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:09.737136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.747045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e998e5-01b4-4f73-be26-bf1c7e5194ad None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.752187 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.752796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.753081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.753359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.754036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:09.754343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.755952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.768479 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1249/2493] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:48:09.772962 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.782805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c5e50-dce6-40f3-954a-6126b05964fb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.787620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.788216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.788499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.788774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.789408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.791381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.819198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1245/2494] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:09 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:09.823370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.833476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6666-5de7-400f-b445-1ff2679b96c7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.884610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:09.891326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.892152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.892648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.893133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.894227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.896338 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.918153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1250/2495] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:09 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:09.922963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.933111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a342348-17f3-4215-8277-c956ae7aa128 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.937820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.938450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.938733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.939011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.939645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.941215 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.952428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1246/2496] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:09.956750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:09.967370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed10355-3701-450e-8b48-14e2a2d94826 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:09.971966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:09.972549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:09.972832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:09.973105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:09.973739 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:09.975372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61e4d9-e79b-4060-95f5-fdd1b45c51f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:09.986355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1251/2497] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:09.990316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.000370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9678-6cdc-4b80-a5e4-6ec1ffda54ce admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.004945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.005585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.005866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.006246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] PATH_INFO: `/v3/projects/e3ac1b3a1ee543ada469e7f18e13be35/users/875a4d10e991420fad90303f467b2174/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.020743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ac1b3a1ee543ada469e7f18e13be35, user_id=875a4d10e991420fad90303f467b2174, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.023622 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.031968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:10.039095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1247/2498] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:09 2022] PUT /identity/v3/projects/e3ac1b3a1ee543ada469e7f18e13be35/users/875a4d10e991420fad90303f467b2174/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:10.050121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.050412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.050691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.078430 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] MFA Rules not processed for user `875a4d10e991420fad90303f467b2174`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:10.079639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:10.144364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1252/2499] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:10.148820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.208518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3679-d508-49f9-aa1d-74f9e754ea71 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.213088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.213681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.213985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.214269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.214890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.217454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.247683 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1248/2500] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:10 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:10.249142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.259877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bad9-53fa-4883-8c71-ac8aaa371560 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.324800 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.325904 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.326229 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.326500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.327165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.329105 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.350949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1253/2501] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:10 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:10.355054 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.365454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbb8-b86f-4073-b64a-d21fc7cd9300 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.370115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.370715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.371001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.371273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.371912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.373533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.384309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1249/2502] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:10.389322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.399926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c77c3-96a1-42ce-8362-818e9a29c3a4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.405209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.406066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.406356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.406629 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] PATH_INFO: `/v3/projects/ba298663e48e432cb7c385fa1a63e1e6/users/cb27bd8b6e5d47fca3278cce11047fe6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.422156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba298663e48e432cb7c385fa1a63e1e6, user_id=cb27bd8b6e5d47fca3278cce11047fe6, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.424916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.438881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1254/2503] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:10 2022] PUT /identity/v3/projects/ba298663e48e432cb7c385fa1a63e1e6/users/cb27bd8b6e5d47fca3278cce11047fe6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:10.442924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.453414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804a60-65a2-4ce4-946f-d42561ebc536 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.524115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.525182 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.525728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.526219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.526903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.528530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce06522-a529-4ef1-905f-08659ed144be admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.539949 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1250/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:10.544247 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.555569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbec07-6bd9-4f30-927a-43631fb74b13 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.560833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.561488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.561767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.562077 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] PATH_INFO: `/v3/projects/ba298663e48e432cb7c385fa1a63e1e6/users/cb27bd8b6e5d47fca3278cce11047fe6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.563976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba298663e48e432cb7c385fa1a63e1e6, user_id=cb27bd8b6e5d47fca3278cce11047fe6, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.566680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.579305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1255/2505] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:10 2022] PUT /identity/v3/projects/ba298663e48e432cb7c385fa1a63e1e6/users/cb27bd8b6e5d47fca3278cce11047fe6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:10.590996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478894a5-c185-48b5-913d-2f164537d926 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.591343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478894a5-c185-48b5-913d-2f164537d926 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.591570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478894a5-c185-48b5-913d-2f164537d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.620646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-478894a5-c185-48b5-913d-2f164537d926 None None] MFA Rules not processed for user `cb27bd8b6e5d47fca3278cce11047fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:10.621874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-478894a5-c185-48b5-913d-2f164537d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:10.693782 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:10.706344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1251/2506] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:10.718327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.720085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:10.742044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:10.783721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9eb-5082-4b4d-992b-e1453e81fdd8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.787852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.788470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.788753 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.789027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.798499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.799936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:10.810125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1256/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:10.906586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478894a5-c185-48b5-913d-2f164537d926 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:10.920834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478894a5-c185-48b5-913d-2f164537d926 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:10.927682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:10.928787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:10.929273 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:10.930132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:10.993934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:10.995406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8ec2-ced2-4118-b098-61be8f02c78a service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:11.005990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1252/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:11.305515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:11.375379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b645c9d-f729-4e06-b5b2-3a4c5c79af9d service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:11.380200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:11.380821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:11.381222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:11.381489 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] PATH_INFO: `/v3/users/875a4d10e991420fad90303f467b2174` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:11.382701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875a4d10e991420fad90303f467b2174)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:11.384652 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:11.414205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:11.414507 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:11.414885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:11.439399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875a4d10e991420fad90303f467b2174'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:11.439941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:11.440074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875a4d10e991420fad90303f467b2174'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:11.441209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:11.448616 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875a4d10e991420fad90303f467b2174'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:11.461667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875a4d10e991420fad90303f467b2174'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:11.462852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e989a7c9-ae4e-4023-8e89-56a21cf2d031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875a4d10e991420fad90303f467b2174'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:11.479831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1257/2509] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:11 2022] DELETE /identity/v3/users/875a4d10e991420fad90303f467b2174 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:11.484636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:11.484906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:11.485209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:11.507137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:11.508376 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:11.512069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1253/2510] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:48:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:11.527083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:11.529126 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:11.552622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:11.590196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1258/2511] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:11.601197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:11.602661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:11.614386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501d3b-5eca-4fe9-af02-6f2e366f4b75 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:11.663414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:11.673178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b3b5-183d-4717-887a-bc0549991476 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:11.678343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:11.678968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:11.679246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:11.679516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:11.692941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:11.694185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:11.694863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:11.696739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:11.697176 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:11.697477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:11.706254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1259/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:11.806770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:11.809542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:11.826665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1254/2513] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:48:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:48:12.113168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:12.115448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:12.262506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef6d1-3f72-4cb8-92c5-12e5a44bdd51 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:12.284312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:12.285662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:12.286261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:12.287364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:12.289902 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:12.307374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:12.311257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:12.341766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:12.343338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:12.357457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1260/2514] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:12.380854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcae826-b6d1-4db7-b007-a15fcc343600 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:12.385833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:12.387033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:12.399608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:12.401585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] PATH_INFO: `/v3/projects/e3ac1b3a1ee543ada469e7f18e13be35` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:12.405548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ac1b3a1ee543ada469e7f18e13be35)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:12.408095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:12.511079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ac1b3a1ee543ada469e7f18e13be35', 'request_id': 'req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.523824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ac1b3a1ee543ada469e7f18e13be35', 'request_id': 'req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.540095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ac1b3a1ee543ada469e7f18e13be35', 'request_id': 'req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.570837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] The token cache is being invalidate because project e3ac1b3a1ee543ada469e7f18e13be35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:12.571129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.574876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.588320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:12.588868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1255/2515] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:12 2022] DELETE /identity/v3/projects/e3ac1b3a1ee543ada469e7f18e13be35 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:12.605019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a948-94cf-4045-a9ea-ffb7e1fbeca9 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:12.682516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:12.683189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:12.683618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:12.683974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] PATH_INFO: `/v3/users/cb27bd8b6e5d47fca3278cce11047fe6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:12.685318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb27bd8b6e5d47fca3278cce11047fe6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:12.687527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:12.704542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:12.775566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb27bd8b6e5d47fca3278cce11047fe6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.776446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb27bd8b6e5d47fca3278cce11047fe6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.786910 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb27bd8b6e5d47fca3278cce11047fe6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.816098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb27bd8b6e5d47fca3278cce11047fe6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.816877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8ef2b81b-9e41-45cc-b8ad-7aadac1da328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb27bd8b6e5d47fca3278cce11047fe6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:12.848458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1261/2516] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:12 2022] DELETE /identity/v3/users/cb27bd8b6e5d47fca3278cce11047fe6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:13.260748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.262237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:13.294271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857b4b-ebd9-4a8d-9216-f0b6a1f24f0e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:13.401658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:13.404407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.413677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.413957 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] PATH_INFO: `/v3/projects/ba298663e48e432cb7c385fa1a63e1e6` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.415958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba298663e48e432cb7c385fa1a63e1e6)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:13.417902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:13.425963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:13.509652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba298663e48e432cb7c385fa1a63e1e6', 'request_id': 'req-cb2084cd-279d-4013-b224-3ed5fc0f0406'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:13.523446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba298663e48e432cb7c385fa1a63e1e6', 'request_id': 'req-cb2084cd-279d-4013-b224-3ed5fc0f0406'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:13.530915 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba298663e48e432cb7c385fa1a63e1e6', 'request_id': 'req-cb2084cd-279d-4013-b224-3ed5fc0f0406'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:13.548471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] The token cache is being invalidate because project ba298663e48e432cb7c385fa1a63e1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:13.548471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:13.549807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cb2084cd-279d-4013-b224-3ed5fc0f0406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:13.551872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1256/2517] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:13 2022] DELETE /identity/v3/projects/ba298663e48e432cb7c385fa1a63e1e6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:13.556400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.556992 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.557415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.582099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:13.583651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:13.663472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1262/2518] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:13.671375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.671672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.671964 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.704834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:13.706836 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:13.719346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1257/2519] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:13.724154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.745598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09af0-e5d3-484f-8ff9-98e1e298f795 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:13.751177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:13.751873 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.752219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.752498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.753204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:13.753455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:13.755098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:13.772044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1263/2520] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:48:13.773602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.784984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ce9b2-64f9-4f8a-bd2c-ec09a5cac250 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:13.791376 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:13.792236 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.792555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.793051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.793702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:13.795793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:13.826278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1258/2521] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:13.830826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.843408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1389d-33c9-42a4-9350-0eff0c23c279 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:13.906505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:13.907116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.907395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.907668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.908400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:13.910488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:13.937988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1264/2522] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:13 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:13.939339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.952717 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f374b0-7d84-493d-9cba-207bbfd277ef admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:13.959910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:13.960547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:13.960830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:13.961088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:13.961751 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:13.963545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:13.976210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1259/2523] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:13.980210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:13.989193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:13.993357 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5be7-0cb6-4102-b1b6-c131e18f6629 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:14.000066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:14.000777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.001198 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.001673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.002529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:14.004468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c1c9-21d8-444e-a93a-debd87e46860 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:14.020748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1265/2524] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:14.024954 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:14.037588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595e23-fc25-46bd-beb1-9262c4f4962f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:14.043618 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:14.044491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.044774 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.045053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] PATH_INFO: `/v3/projects/f5ec4d0b0cfa43af967f5ef46e9310be/users/8ad4bb3c0b44464e93980d22292de176/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.065223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ec4d0b0cfa43af967f5ef46e9310be, user_id=8ad4bb3c0b44464e93980d22292de176, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:14.069386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:14.086306 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1260/2525] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:14 2022] PUT /identity/v3/projects/f5ec4d0b0cfa43af967f5ef46e9310be/users/8ad4bb3c0b44464e93980d22292de176/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:14.098934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.099219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.099492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.129851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] MFA Rules not processed for user `8ad4bb3c0b44464e93980d22292de176`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:14.131100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:14.211711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1266/2526] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:14.223491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:14.225288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:14.304812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5db5f-b85d-4d2e-bcc9-59209d3b25c3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:14.308492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:14.309129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.309400 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.310266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.319361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:14.320833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8d88a-a5f6-4d02-a56a-18238de3031e service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:14.334241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1261/2527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:14.358669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:14.427072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27a557-fb22-48c3-a82f-b09477363473 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:14.432144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:14.432806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.433085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.433387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] PATH_INFO: `/v3/users/8ad4bb3c0b44464e93980d22292de176` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.434570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad4bb3c0b44464e93980d22292de176)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:14.436502 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:14.503748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad4bb3c0b44464e93980d22292de176'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:14.504961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad4bb3c0b44464e93980d22292de176'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:14.512536 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad4bb3c0b44464e93980d22292de176'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:14.527137 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad4bb3c0b44464e93980d22292de176'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:14.528179 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad4bb3c0b44464e93980d22292de176'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:14.547398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1267/2528] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:14 2022] DELETE /identity/v3/users/8ad4bb3c0b44464e93980d22292de176 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:14.552942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.553432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.553659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.588841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:14.590113 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:14.623164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:14.691586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1262/2529] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:14.692089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:14.692089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:14.694677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:14.774724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d6fd-2477-41f9-97d0-25be2bfad392 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:14.779154 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:14.779768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:14.780045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:14.780319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:14.791204 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:14.792658 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045d95c-ff07-4df1-ae16-f1267b104a79 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:14.814054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1268/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:15.128024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.129754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:15.145609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df825a2-0cc6-4341-a4c8-130b5d2607f0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.150956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.151606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.151886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.152160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] PATH_INFO: `/v3/projects/f5ec4d0b0cfa43af967f5ef46e9310be` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.153322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ec4d0b0cfa43af967f5ef46e9310be)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.155320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.208759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ec4d0b0cfa43af967f5ef46e9310be', 'request_id': 'req-f741f6bc-a03b-401c-8457-07bb4f728fb9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:15.219660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ec4d0b0cfa43af967f5ef46e9310be', 'request_id': 'req-f741f6bc-a03b-401c-8457-07bb4f728fb9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:15.227257 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ec4d0b0cfa43af967f5ef46e9310be', 'request_id': 'req-f741f6bc-a03b-401c-8457-07bb4f728fb9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:15.237464 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] The token cache is being invalidate because project f5ec4d0b0cfa43af967f5ef46e9310be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:15.237759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:15.238448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f741f6bc-a03b-401c-8457-07bb4f728fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:15.240185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1263/2531] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:15 2022] DELETE /identity/v3/projects/f5ec4d0b0cfa43af967f5ef46e9310be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:15.244997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.245364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.245690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.267569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:15.268785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:15.335429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1269/2532] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:15.343956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.344353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.344824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.369721 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:15.371062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:15.379328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1264/2533] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:15.383589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.394425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32445-b9d2-4d45-9120-e4bfefd652f1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.399078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.399693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.399977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.400250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.400905 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:15.401210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.402892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.419331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1270/2534] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:15.421081 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.430718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95f5e1-53f6-4544-8a43-28f0571a5288 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.435756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.436360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.436887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.437251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.437905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.440239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.472044 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1265/2535] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:15.473172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.484056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522391-a76d-4ca8-838b-35a68868552b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.547210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.547841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.548104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.548378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.549207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.551200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.574523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1271/2536] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:15.579249 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.589970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433099-e573-44cf-8b04-15e03bb3c95f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.595172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.595813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.596129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.596361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.597005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.598631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.612418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1266/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:15.613605 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.624045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8f54-ef4f-418b-86b0-fe39ed8f8d5d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.628779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.629491 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.629781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.630104 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.630750 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.632677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed43b-07ca-446e-8ed5-f0a53124af17 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.645088 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1272/2538] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:15.649344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.660374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179246-4ecd-4295-8af3-9431387b3f9a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.665626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.666322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.666606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.666877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] PATH_INFO: `/v3/projects/7e25045eae2f4278b9f224f606a36107/users/247c067ccc66447da8341bf460b290fb/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.682181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e25045eae2f4278b9f224f606a36107, user_id=247c067ccc66447da8341bf460b290fb, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.684889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:15.701267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1267/2539] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:15 2022] PUT /identity/v3/projects/7e25045eae2f4278b9f224f606a36107/users/247c067ccc66447da8341bf460b290fb/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:15.711538 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.712049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.712133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.744907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:15.755048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] MFA Rules not processed for user `247c067ccc66447da8341bf460b290fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:15.757341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:15.858129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1273/2540] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:15.859345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:15.929866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:15.942263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d716-d1d7-4fcc-9f5d-88f83a59047f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:15.950009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:15.951699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:15.952523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:15.952823 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:15.953512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:15.964396 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.002072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1268/2541] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:16.005748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.018827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663ec7-7a4f-4dff-808f-fe3ce7d7a60b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.096826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.097452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.097734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.098037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.098690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.100654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.124581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1274/2542] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:16 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:16.128154 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.140328 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f45a-e961-4ce7-bc95-6de0ae30c01d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.151368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.152061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.152361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.152757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.153485 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.155119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.166617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1269/2543] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:16.171373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.181659 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed9759-9c75-4abd-8bb5-e6bc13da60b2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.187112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.187727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.188010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.188286 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.188932 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.190580 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a9df-9c8c-4a48-a72b-3332c2dad3f5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.201830 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1275/2544] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:16.205790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.216190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecac15-4d85-4681-b08a-ff5b966f42f6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.220771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.221455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.221736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.222052 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] PATH_INFO: `/v3/projects/ef412710164247a6bba0b1878119cdd1/users/65a7dcbeee584441b6b4bfd8d28e83ae/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.239145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef412710164247a6bba0b1878119cdd1, user_id=65a7dcbeee584441b6b4bfd8d28e83ae, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.241806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.260938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1270/2545] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:16 2022] PUT /identity/v3/projects/ef412710164247a6bba0b1878119cdd1/users/65a7dcbeee584441b6b4bfd8d28e83ae/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:16.272936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.273251 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.273507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.319809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] MFA Rules not processed for user `65a7dcbeee584441b6b4bfd8d28e83ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:16.321092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:16.396684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1276/2546] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:16.401125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.471502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfdeaa-666c-4b75-ba82-abd2ef76d9f7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.476141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.476757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.477033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.477305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.477934 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.479887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.512706 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1271/2547] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:16 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:16.514366 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.525795 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53f2b-ceee-4a0d-a09b-566974eb9647 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.532860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:16.590597 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.591401 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.591783 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.592157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.593030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.595071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.618123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1277/2548] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:16 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:16.623170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.635773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206fd10-b160-4133-82da-fbf92c3feede admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.641168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.641784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.642103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.642380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.643033 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.644612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.656886 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1272/2549] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:16.661467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.672076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c9b5a-74d6-4a55-8352-2370a098046f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.677061 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.678017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.678363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.678721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] PATH_INFO: `/v3/projects/4489467b5b344959ad8784b7c32d58d3/users/fd8449c7d6fa4139808f3d8a44195d98/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.697523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4489467b5b344959ad8784b7c32d58d3, user_id=fd8449c7d6fa4139808f3d8a44195d98, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.701103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.716730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1278/2550] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:16 2022] PUT /identity/v3/projects/4489467b5b344959ad8784b7c32d58d3/users/fd8449c7d6fa4139808f3d8a44195d98/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:16.720754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.731472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782127b-5555-4a02-b3f6-02dd1da328f0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.791667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.792284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.792560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.792832 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.793469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.795123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d7cb8-372a-4ba2-973d-2a90cb50236e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.805686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1273/2551] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:16.810644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.821709 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e074706-c4ba-48fe-b96f-4d1c4d01044a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:16.830486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:16.831260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.831612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.831995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] PATH_INFO: `/v3/projects/4489467b5b344959ad8784b7c32d58d3/users/fd8449c7d6fa4139808f3d8a44195d98/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.834306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4489467b5b344959ad8784b7c32d58d3, user_id=fd8449c7d6fa4139808f3d8a44195d98, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:16.837067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:16.848473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1279/2552] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:16 2022] PUT /identity/v3/projects/4489467b5b344959ad8784b7c32d58d3/users/fd8449c7d6fa4139808f3d8a44195d98/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:16.858981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:16.859359 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:16.859710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:16.885998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:16.890195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] MFA Rules not processed for user `fd8449c7d6fa4139808f3d8a44195d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:16.892014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:16.983262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1274/2553] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:16.995998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:16.998458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:17.091542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf1a2-81c4-43ef-8059-ee0183f15163 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:17.100290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:17.101010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:17.101512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:17.102311 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:17.226221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:17.227695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:17.238619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1280/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:18.876124 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:18.878416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:18.890818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efbed-38dd-45fc-b9cb-24e813098162 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:18.894387 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:18.894989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:18.895267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:18.895539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:18.958289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:18.960037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:18.970439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1275/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:19.756822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:19.766923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7abd6-9969-4894-9af6-387a234d8f4b service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:19.773699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:19.773699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:19.773699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:19.773699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:19.785822 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:19.787346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c944ed-e113-42f0-9235-889eeab580ae service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:19.802093 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1281/2556] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:23.689841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:23.754608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd18e8-af6e-47e3-af0a-c8599bb391c7 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:23.764857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:23.765488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:23.765771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:23.766085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] PATH_INFO: `/v3/users/247c067ccc66447da8341bf460b290fb` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:23.767208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247c067ccc66447da8341bf460b290fb)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:23.769125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:23.816217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:23.822967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247c067ccc66447da8341bf460b290fb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:23.823784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247c067ccc66447da8341bf460b290fb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:23.833472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247c067ccc66447da8341bf460b290fb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:23.847247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247c067ccc66447da8341bf460b290fb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:23.847977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247c067ccc66447da8341bf460b290fb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:23.861521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1276/2557] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:23 2022] DELETE /identity/v3/users/247c067ccc66447da8341bf460b290fb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:23.866432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:23.866929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:23.867043 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:23.874358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:23.890427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:23.891636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:23.951884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1282/2558] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:23.961672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:23.963111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:24.019661 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa635ae-771d-46fb-b0c9-ff49c7fbdfd2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:24.023314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:24.023916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:24.024191 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:24.024460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:24.033496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:24.034938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:24.045972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1277/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:24.310980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:24.312398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:24.324340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbb7c5-a95d-4706-9728-712b7f931711 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:24.329001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:24.329638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:24.329918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:24.330224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] PATH_INFO: `/v3/projects/7e25045eae2f4278b9f224f606a36107` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:24.331471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e25045eae2f4278b9f224f606a36107)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:24.333386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:24.385721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e25045eae2f4278b9f224f606a36107', 'request_id': 'req-16f7665f-7089-43f0-96e8-08e82797d20f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.393699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e25045eae2f4278b9f224f606a36107', 'request_id': 'req-16f7665f-7089-43f0-96e8-08e82797d20f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.400083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e25045eae2f4278b9f224f606a36107', 'request_id': 'req-16f7665f-7089-43f0-96e8-08e82797d20f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.411369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] The token cache is being invalidate because project 7e25045eae2f4278b9f224f606a36107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:24.411656 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.412279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.413748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1283/2560] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:24 2022] DELETE /identity/v3/projects/7e25045eae2f4278b9f224f606a36107 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:24.417747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:24.427340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a696-08d1-430c-b148-6f1ba9ec830b service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:24.484384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:24.484926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:24.485210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:24.485487 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] PATH_INFO: `/v3/users/65a7dcbeee584441b6b4bfd8d28e83ae` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:24.486617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a7dcbeee584441b6b4bfd8d28e83ae)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:24.488527 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:24.533502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a7dcbeee584441b6b4bfd8d28e83ae'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.534172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a7dcbeee584441b6b4bfd8d28e83ae'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.541308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a7dcbeee584441b6b4bfd8d28e83ae'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.545995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:24.555402 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a7dcbeee584441b6b4bfd8d28e83ae'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.556078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a7dcbeee584441b6b4bfd8d28e83ae'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:24.567992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1278/2561] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:24 2022] DELETE /identity/v3/users/65a7dcbeee584441b6b4bfd8d28e83ae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:24.851916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:24.853544 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:24.867318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7665f-7089-43f0-96e8-08e82797d20f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:24.938498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:24.939130 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:24.939425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:24.939675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] PATH_INFO: `/v3/projects/ef412710164247a6bba0b1878119cdd1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:24.942738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef412710164247a6bba0b1878119cdd1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:24.942738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:24.982808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:25.014369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef412710164247a6bba0b1878119cdd1', 'request_id': 'req-0ec88833-abe3-4029-854f-d6f1d719cd1b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.024662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef412710164247a6bba0b1878119cdd1', 'request_id': 'req-0ec88833-abe3-4029-854f-d6f1d719cd1b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.034129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef412710164247a6bba0b1878119cdd1', 'request_id': 'req-0ec88833-abe3-4029-854f-d6f1d719cd1b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.047055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] The token cache is being invalidate because project ef412710164247a6bba0b1878119cdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:25.047316 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.050062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.052244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1284/2562] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:24 2022] DELETE /identity/v3/projects/ef412710164247a6bba0b1878119cdd1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:25.056456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:25.058813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:25.066476 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:25.068172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:25.081255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14658e4-90f5-4315-b1e6-9f75de99c329 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:25.224827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88833-abe3-4029-854f-d6f1d719cd1b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:25.233339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:25.234004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:25.234292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:25.234590 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:25.236301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:25.238405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:25.239032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:25.239512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:25.239791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] PATH_INFO: `/v3/users/fd8449c7d6fa4139808f3d8a44195d98` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:25.241380 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8449c7d6fa4139808f3d8a44195d98)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:25.243361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:25.249920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:25.251690 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:25.263014 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1285/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:25.300731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8449c7d6fa4139808f3d8a44195d98'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.301381 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8449c7d6fa4139808f3d8a44195d98'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.308862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8449c7d6fa4139808f3d8a44195d98'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.331534 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8449c7d6fa4139808f3d8a44195d98'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.332347 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82e4f347-bfab-48f9-8e38-734da7e6862b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8449c7d6fa4139808f3d8a44195d98'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.350478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1279/2564] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:25 2022] DELETE /identity/v3/users/fd8449c7d6fa4139808f3d8a44195d98 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:25.693978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:25.695452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:25.709531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce429e5-af12-49e1-80c8-5a4516704700 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:25.767671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:25.768295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:25.768581 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:25.768880 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] PATH_INFO: `/v3/projects/4489467b5b344959ad8784b7c32d58d3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:25.770005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4489467b5b344959ad8784b7c32d58d3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:25.771913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:25.813055 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:25.817013 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4489467b5b344959ad8784b7c32d58d3', 'request_id': 'req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.824695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4489467b5b344959ad8784b7c32d58d3', 'request_id': 'req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.831337 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4489467b5b344959ad8784b7c32d58d3', 'request_id': 'req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.841319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] The token cache is being invalidate because project 4489467b5b344959ad8784b7c32d58d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:25.841606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.842252 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:25.843700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1286/2565] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:25 2022] DELETE /identity/v3/projects/4489467b5b344959ad8784b7c32d58d3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:26.741184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:26.741711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:26.741807 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:26.761703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:26.762969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:26.817457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1280/2566] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:26.830354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:26.831732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:26.900603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34c530-b695-4ff2-b3ce-cbd6f4eea643 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:26.906913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:26.907512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:26.907793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:26.908067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:26.916358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:26.917923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:26.925848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1287/2567] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:48:27.546633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:27.548025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:27.552858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:27.605447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc3d74-48f3-433d-adcd-355127c1731f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:27.609027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:27.609631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:27.609912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:27.610227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:27.611924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:27.674472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:27.675899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:27.685556 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1281/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:30.545484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:30.548398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:30.565128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce61f1-b55f-43e2-bd96-d811f9b6e704 service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:30.570017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:30.570647 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:30.570931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:30.571207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] PATH_INFO: `/v3/users/06577b267fec462c87bfff97abe065de` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:30.572343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06577b267fec462c87bfff97abe065de)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:30.574515 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:30.626012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06577b267fec462c87bfff97abe065de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.626662 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06577b267fec462c87bfff97abe065de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.633508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06577b267fec462c87bfff97abe065de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.645145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06577b267fec462c87bfff97abe065de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.645767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3457ee05-b409-4fe7-80b2-68310d3deb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06577b267fec462c87bfff97abe065de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.658425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1288/2569] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:30 2022] DELETE /identity/v3/users/06577b267fec462c87bfff97abe065de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:30.829838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:30.840068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fea9c-dd8c-4fee-8cb1-cfd128f13f7f service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:30.896845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:30.897564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:30.897838 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:30.898150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] PATH_INFO: `/v3/projects/bea9e83441744745b716e4554911e465` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:30.899297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea9e83441744745b716e4554911e465)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:30.901251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:30.949293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea9e83441744745b716e4554911e465', 'request_id': 'req-4b18a39a-1be2-4440-bc5b-1004a243d07d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.953261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:30.956982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea9e83441744745b716e4554911e465', 'request_id': 'req-4b18a39a-1be2-4440-bc5b-1004a243d07d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.964621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea9e83441744745b716e4554911e465', 'request_id': 'req-4b18a39a-1be2-4440-bc5b-1004a243d07d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.975349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] The token cache is being invalidate because project bea9e83441744745b716e4554911e465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:30.975634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.976276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4b18a39a-1be2-4440-bc5b-1004a243d07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:30.977756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1282/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:30 2022] DELETE /identity/v3/projects/bea9e83441744745b716e4554911e465 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:30.982582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de707-a84c-415b-9018-65136735a348 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:30.982870 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de707-a84c-415b-9018-65136735a348 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:30.983762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de707-a84c-415b-9018-65136735a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.002685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-088de707-a84c-415b-9018-65136735a348 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:31.003868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-088de707-a84c-415b-9018-65136735a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:31.032207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:31.063698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1289/2571] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:31.071432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.071720 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.071995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.091122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:31.092326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:31.100569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1283/2572] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:31.104523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de707-a84c-415b-9018-65136735a348 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.114793 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de707-a84c-415b-9018-65136735a348 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.119330 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.119949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.120224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.120500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.121134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:31.121434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.123051 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.134390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1290/2573] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:31.138493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.148121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335069b-8a55-410f-bb28-055c1cb8b6ba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.152677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.153270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.153547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.153820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.154501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.156916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.190014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1284/2574] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:31.194452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.205007 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042d84-7aba-4c74-b41f-97478b3e18b3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.261128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.261720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.262045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.262322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.262946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.265352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.289789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1291/2575] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:31.293744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.304121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d955956-ee10-4b0d-babf-aad5606cacca admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.308767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.309364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.309646 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.309920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.310585 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.312194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.321973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1285/2576] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:31.325668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.335861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c7d5-73d5-4120-add2-6a3b2b0fbb87 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.340404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.340986 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.341262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.341531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.342192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.344417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a036f5c-49b4-4b52-8e23-5b4821574caf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.354781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1292/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:31.359615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.369441 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1254dad-9779-4a4b-ab68-5ecb4caf66ef admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.374125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.374794 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.375075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.375351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] PATH_INFO: `/v3/projects/1bdc99504f3f433d9fc6d23f36992ac0/users/49286ac4dd7445fead7695374b757899/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.390469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdc99504f3f433d9fc6d23f36992ac0, user_id=49286ac4dd7445fead7695374b757899, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.393079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.406331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1286/2578] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:31 2022] PUT /identity/v3/projects/1bdc99504f3f433d9fc6d23f36992ac0/users/49286ac4dd7445fead7695374b757899/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:31.416614 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.416903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.417173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.444663 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] MFA Rules not processed for user `49286ac4dd7445fead7695374b757899`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:31.445876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:31.511110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1293/2579] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:31.516427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.576161 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea11c-fc43-4f09-9735-a12ca11cc9f2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.581600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.582241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.582519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.582790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.583416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.585308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.611952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1287/2580] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:31.616019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.627351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47db97-189f-4afb-a214-9a1da396e7f5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.653005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:31.683045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.683648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.683929 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.684201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.684863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.687325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.708637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1294/2581] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:31.712616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.723373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc9-6b5a-4e3c-886d-0aa142e72efe admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.727885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.728471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.728747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.729018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.729647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.731283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.741995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1288/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:31.745840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.755730 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ddb51-4493-4fe9-a23a-d9664d08bc07 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.760261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.760896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.761175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.761447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] PATH_INFO: `/v3/projects/d9e82b08e6e6423090af87ce52080d7f/users/71750b27a1c14094a184156b2e96b8d1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.775931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e82b08e6e6423090af87ce52080d7f, user_id=71750b27a1c14094a184156b2e96b8d1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.778613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.791811 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1295/2583] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:31 2022] PUT /identity/v3/projects/d9e82b08e6e6423090af87ce52080d7f/users/71750b27a1c14094a184156b2e96b8d1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:31.796383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.806022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4c23-023c-443a-83fa-8b05a467da8a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.851229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:31.862314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.863186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.863668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.864132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.864824 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.866477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bbb9-de8f-4964-a1d4-bc25254b0749 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.876244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1289/2584] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:31.880421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:31.891912 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688bfaa-f220-44c0-bdf5-938a37dd73e4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:31.896856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:31.897736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.898112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.898483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] PATH_INFO: `/v3/projects/d9e82b08e6e6423090af87ce52080d7f/users/71750b27a1c14094a184156b2e96b8d1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.900477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e82b08e6e6423090af87ce52080d7f, user_id=71750b27a1c14094a184156b2e96b8d1, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:31.903293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:31.915022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1296/2585] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:31 2022] PUT /identity/v3/projects/d9e82b08e6e6423090af87ce52080d7f/users/71750b27a1c14094a184156b2e96b8d1/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:31.926978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41761-598c-4293-a7c0-026586404e6f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:31.927338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41761-598c-4293-a7c0-026586404e6f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:31.927682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d41761-598c-4293-a7c0-026586404e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:31.958074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-56d41761-598c-4293-a7c0-026586404e6f None None] MFA Rules not processed for user `71750b27a1c14094a184156b2e96b8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:31.959795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-56d41761-598c-4293-a7c0-026586404e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:32.030327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1290/2586] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:32.041076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:32.042845 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:32.099325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f5146-8d32-4163-a09a-f71405a25e04 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:32.103027 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:32.103568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:32.103850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:32.104123 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:32.113375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:32.114853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:32.124677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1297/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:32.225006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41761-598c-4293-a7c0-026586404e6f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:32.235220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d41761-598c-4293-a7c0-026586404e6f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:32.238765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:32.239361 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:32.239641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:32.239910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:32.295439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:32.299406 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da14b-943e-4979-b162-d0d78ec389f2 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:32.308429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1291/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:34.885788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:34.946604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9860c-1ffb-403a-967c-bf2e99ee9804 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:34.952356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:34.953046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:34.953325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:34.953600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] PATH_INFO: `/v3/users/49286ac4dd7445fead7695374b757899` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:34.954749 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49286ac4dd7445fead7695374b757899)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:34.956649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:34.984078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:35.003135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49286ac4dd7445fead7695374b757899'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.003777 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49286ac4dd7445fead7695374b757899'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.010589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49286ac4dd7445fead7695374b757899'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.022674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49286ac4dd7445fead7695374b757899'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.023298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49286ac4dd7445fead7695374b757899'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.036203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1298/2589] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:34 2022] DELETE /identity/v3/users/49286ac4dd7445fead7695374b757899 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:35.040713 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:35.041172 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:35.041307 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:35.060325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:35.061522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:35.120770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1292/2590] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:35.136063 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:35.137464 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:35.194429 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011e588-9893-4875-924f-6d096aeff010 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:35.198103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:35.198712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:35.198995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:35.199291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:35.208844 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:35.210318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:35.220393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1299/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:35.485209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:35.486837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:35.500290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94501e-fbee-41bf-bc34-21d121315a98 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:35.505603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:35.506283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:35.506566 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:35.506894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] PATH_INFO: `/v3/projects/1bdc99504f3f433d9fc6d23f36992ac0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:35.508021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdc99504f3f433d9fc6d23f36992ac0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:35.509920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:35.518916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:35.557221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdc99504f3f433d9fc6d23f36992ac0', 'request_id': 'req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.565395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdc99504f3f433d9fc6d23f36992ac0', 'request_id': 'req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.571819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdc99504f3f433d9fc6d23f36992ac0', 'request_id': 'req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.582541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] The token cache is being invalidate because project 1bdc99504f3f433d9fc6d23f36992ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:35.582850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.583491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.585102 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1293/2592] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:35 2022] DELETE /identity/v3/projects/1bdc99504f3f433d9fc6d23f36992ac0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:35.588998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:35.599425 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667893ac-d7b3-4548-8f52-4224ad645143 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:35.668113 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:35.668792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:35.669122 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:35.669394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] PATH_INFO: `/v3/users/71750b27a1c14094a184156b2e96b8d1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:35.671359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71750b27a1c14094a184156b2e96b8d1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:35.673387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:35.731065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71750b27a1c14094a184156b2e96b8d1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.731834 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71750b27a1c14094a184156b2e96b8d1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.733603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:35.743164 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71750b27a1c14094a184156b2e96b8d1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.760602 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71750b27a1c14094a184156b2e96b8d1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.761547 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d806915e-ee48-47c7-96aa-c92e4a62d802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71750b27a1c14094a184156b2e96b8d1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:35.774875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1300/2593] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:35 2022] DELETE /identity/v3/users/71750b27a1c14094a184156b2e96b8d1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:36.051350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.053345 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:36.066623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0301-fbf2-4e06-9373-cbcc6fa38bcb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.122284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.122913 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.123194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.123466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] PATH_INFO: `/v3/projects/d9e82b08e6e6423090af87ce52080d7f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.124591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e82b08e6e6423090af87ce52080d7f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.126524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.172162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e82b08e6e6423090af87ce52080d7f', 'request_id': 'req-1bb0c489-b59f-4c55-b59f-7b604b018304'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:36.178876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e82b08e6e6423090af87ce52080d7f', 'request_id': 'req-1bb0c489-b59f-4c55-b59f-7b604b018304'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:36.184923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e82b08e6e6423090af87ce52080d7f', 'request_id': 'req-1bb0c489-b59f-4c55-b59f-7b604b018304'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:36.194874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] The token cache is being invalidate because project d9e82b08e6e6423090af87ce52080d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:36.195167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:36.195795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1bb0c489-b59f-4c55-b59f-7b604b018304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:36.197252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1294/2594] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:36 2022] DELETE /identity/v3/projects/d9e82b08e6e6423090af87ce52080d7f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:36.202059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.202554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.202666 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.222504 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:36.223762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:36.284188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1301/2595] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:36.291987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.292276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.292557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.312752 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:36.313961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:36.321728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1295/2596] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:36.325761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.335319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507f0c-0c15-412c-98b6-6c5502697fec None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.339802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.340386 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.340664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.340934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.341573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:36.341874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.343987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.355348 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1302/2597] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:36.362091 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.372175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7fa4-b0ec-4c14-a017-9f9e336d9746 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.376798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.377404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.377682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.377966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.378705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.380703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.402453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:36.411846 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1296/2598] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:36.415966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.426360 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb8082-a051-4431-abbc-467adaf48752 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.497197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.497802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.498110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.498382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.499030 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.500935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.523758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1303/2599] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:36.527905 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.539204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6be10-b1e1-447c-a790-d67367dc6321 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.543903 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.544592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.544941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.545226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.545933 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.547589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.560641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1297/2600] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:36.561794 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.572133 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e8de-7bea-4e1f-a1f3-9193aa2d903a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.577400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.578050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.578333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.578607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.579261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.580913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6249705-5b44-4548-aede-59e487eb7c29 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.596228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1304/2601] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:36.597608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.608697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fad83-f11e-456d-a9e9-cb86a540269b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.613471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.614277 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.614643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.614984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] PATH_INFO: `/v3/projects/5732d535a619482381127e032348301c/users/f2ea9992d63b436888f0fac6f20f35f4/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.631337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732d535a619482381127e032348301c, user_id=f2ea9992d63b436888f0fac6f20f35f4, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.634123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.649125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1298/2602] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:36 2022] PUT /identity/v3/projects/5732d535a619482381127e032348301c/users/f2ea9992d63b436888f0fac6f20f35f4/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:36.660125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.660638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.661288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.695320 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] MFA Rules not processed for user `f2ea9992d63b436888f0fac6f20f35f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:36.696646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:36.716548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:36.778769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1305/2603] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:36.780520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.844570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ec5e-7d41-4e50-b884-f717cebceb36 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.849439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.850162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.850512 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.850790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.851421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.853335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.883043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1299/2604] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:36.884172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.895534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaf817-a872-4cee-899c-9320d49402ec None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:36.954949 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:36.955503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:36.955781 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:36.956058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:36.956694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:36.958657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:36.980486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1306/2605] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:36 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:36.984812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:36.995418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e49f29-fdc1-4ddb-98ca-9cb66ed98e52 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.000083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.000691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.000975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.001253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.001892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.003517 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.014221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1300/2606] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:37.018248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:37.028228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc3c8-3db3-4713-ad05-0f6241da3daf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.033324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.034115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.034397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.034677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] PATH_INFO: `/v3/projects/c2419a31e03142b9808ef737bb485126/users/7722216356ec4c74b13d0293b1eed4c3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.052305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2419a31e03142b9808ef737bb485126, user_id=7722216356ec4c74b13d0293b1eed4c3, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.055399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.069694 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1307/2607] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:37 2022] PUT /identity/v3/projects/c2419a31e03142b9808ef737bb485126/users/7722216356ec4c74b13d0293b1eed4c3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:37.073675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:37.083795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de082b52-fc75-45f3-ae19-12ec1984d579 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.142862 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.143473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.143755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.144028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.144669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.146283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294050-6912-4834-8872-f6c75a84eaca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.156766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1301/2608] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:37.161416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:37.172194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111da9-8c24-49c1-bc59-f5f1c08ccda8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.176831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.177558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.177881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.178222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] PATH_INFO: `/v3/projects/c2419a31e03142b9808ef737bb485126/users/7722216356ec4c74b13d0293b1eed4c3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.180317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2419a31e03142b9808ef737bb485126, user_id=7722216356ec4c74b13d0293b1eed4c3, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.183219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.194403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1308/2609] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:37 2022] PUT /identity/v3/projects/c2419a31e03142b9808ef737bb485126/users/7722216356ec4c74b13d0293b1eed4c3/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:37.206137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.206356 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.206638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.239904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] MFA Rules not processed for user `7722216356ec4c74b13d0293b1eed4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:37.241108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:37.261930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:37.310763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1302/2610] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:37.322070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:37.323842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:37.381548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388961ff-b2d3-4d25-88b8-eb0530e8418c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.385349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.385963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.386256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.386522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.396048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.397473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.407175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1309/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:37.488511 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:37.498292 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980c7e-cb38-4f48-8cb4-4d89da037c3d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:37.502421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:37.503156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:37.503424 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:37.503695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:37.560013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:37.562230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bdcf-53a2-43a0-8c77-77bf3e45b95e service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:37.572055 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1303/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:42.372653 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:42.391018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:42.440370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec9c2b-cea8-4efb-a05e-195b727f039a service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:42.445021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:42.445643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:42.445919 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:42.446223 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] PATH_INFO: `/v3/users/f2ea9992d63b436888f0fac6f20f35f4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:42.447322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ea9992d63b436888f0fac6f20f35f4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:42.449352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:42.497558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ea9992d63b436888f0fac6f20f35f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:42.498186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ea9992d63b436888f0fac6f20f35f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:42.505746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ea9992d63b436888f0fac6f20f35f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:42.519678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ea9992d63b436888f0fac6f20f35f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:42.520341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ea9992d63b436888f0fac6f20f35f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:42.537145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1310/2613] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:42 2022] DELETE /identity/v3/users/f2ea9992d63b436888f0fac6f20f35f4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:42.541614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:42.542128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:42.542224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:42.562889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:42.564092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:42.741374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1304/2614] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:42.751033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:42.752481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:42.813087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68dad-8727-4ae4-99a3-958cea7bbec1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:42.816674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:42.817288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:42.817561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:42.817828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:42.827056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:42.828486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:42.837956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1311/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:43.107971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:43.110032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:43.121813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca212b-764e-4681-bbda-6df1d37281cb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:43.126409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:43.127039 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.127321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.127595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] PATH_INFO: `/v3/projects/5732d535a619482381127e032348301c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.128716 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5732d535a619482381127e032348301c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:43.130668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:43.185448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5732d535a619482381127e032348301c', 'request_id': 'req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.188135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:43.194548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5732d535a619482381127e032348301c', 'request_id': 'req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.202796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5732d535a619482381127e032348301c', 'request_id': 'req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.213847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] The token cache is being invalidate because project 5732d535a619482381127e032348301c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:43.214162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.214889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.216449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1305/2616] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:43 2022] DELETE /identity/v3/projects/5732d535a619482381127e032348301c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:43.221216 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:43.231384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89611d9-ae0f-4577-a9be-9225284fc281 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:43.264022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:43.296553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:43.297188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.297473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.297748 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] PATH_INFO: `/v3/users/7722216356ec4c74b13d0293b1eed4c3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.298915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7722216356ec4c74b13d0293b1eed4c3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:43.300835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:43.352327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7722216356ec4c74b13d0293b1eed4c3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.352974 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7722216356ec4c74b13d0293b1eed4c3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.360261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7722216356ec4c74b13d0293b1eed4c3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.372810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7722216356ec4c74b13d0293b1eed4c3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.373457 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c32d5dd1-7c33-41aa-8fce-6fca6cfc044e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7722216356ec4c74b13d0293b1eed4c3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.388649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1312/2617] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:43 2022] DELETE /identity/v3/users/7722216356ec4c74b13d0293b1eed4c3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:43.669340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:43.670912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:43.684614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84a2c-71f1-4783-a0ab-c4b3ec912f88 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:43.744178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:43.744809 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.745133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.745404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] PATH_INFO: `/v3/projects/c2419a31e03142b9808ef737bb485126` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.746530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2419a31e03142b9808ef737bb485126)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:43.749312 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:43.795966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2419a31e03142b9808ef737bb485126', 'request_id': 'req-2f4891e4-0305-4943-a731-7c0599365fec'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.803882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2419a31e03142b9808ef737bb485126', 'request_id': 'req-2f4891e4-0305-4943-a731-7c0599365fec'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.810602 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2419a31e03142b9808ef737bb485126', 'request_id': 'req-2f4891e4-0305-4943-a731-7c0599365fec'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.821677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] The token cache is being invalidate because project c2419a31e03142b9808ef737bb485126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:43.821993 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.822635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2f4891e4-0305-4943-a731-7c0599365fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:43.824097 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1306/2618] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:43 2022] DELETE /identity/v3/projects/c2419a31e03142b9808ef737bb485126 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:43.829516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.829810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.830125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.849277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:43.850520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:43.909780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1313/2619] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:43.917769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.918094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.918377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.938707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:43.940408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:43.950710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1307/2620] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:43.955067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:43.964943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81c516-5df1-4191-bd21-aaed6e2e78cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:43.969506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:43.970132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:43.970414 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:43.970685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:43.971329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:43.971634 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:43.973222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:43.985080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1314/2621] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:43.989263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:43.998407 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662e01-db0c-4403-8451-ae0562dbea4e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.003755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.004350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.004630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.004900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.005532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.007451 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.036101 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1308/2622] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:43 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:44.037601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:44.049575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6a31-227f-4abb-9545-6ff08b307299 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.092095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:44.110129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.110738 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.111152 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.111331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.111907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.113860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.135200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1315/2623] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:44.139289 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:44.149638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757884a-58d8-4144-b2ee-e4eaab6b3271 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.154260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.154845 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.155119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.155384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.156010 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.157569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.167603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1309/2624] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:44.171893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:44.181867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2782-2328-4e2a-877d-c0bd8412cf14 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.187125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.187746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.188036 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.188310 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.188946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.190573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30904a0c-86f1-49c9-a241-d66beb929c61 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.200980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1316/2625] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:44.204806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:44.214447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a914b-e5f6-45be-ae12-3caf7bca3dbb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.219421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.220053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.220330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.220599 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] PATH_INFO: `/v3/projects/4b84558823124afc8f1ca43bb4c7933a/users/9d2c7dd5446746758ce59c6e444a391d/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.235042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b84558823124afc8f1ca43bb4c7933a, user_id=9d2c7dd5446746758ce59c6e444a391d, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.237630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.252627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1310/2626] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:44 2022] PUT /identity/v3/projects/4b84558823124afc8f1ca43bb4c7933a/users/9d2c7dd5446746758ce59c6e444a391d/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:48:44.264512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.264802 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.265087 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.294644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] MFA Rules not processed for user `9d2c7dd5446746758ce59c6e444a391d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:44.296475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:44.362451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1317/2627] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:44.372882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:44.374718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:44.385316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:44.435641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358f35-eee4-4a6a-bac0-b4d03b5d71f9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:44.440096 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:44.440702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:44.440976 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:44.441245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:44.449616 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:44.451065 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633731f-2ba2-40c4-b359-6eea000fdaf0 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:44.460427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1311/2628] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:49.807351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:49.870480 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba111-8496-446c-b380-1453ebbe7447 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:49.875016 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:49.875643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:49.875923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:49.876328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] PATH_INFO: `/v3/users/9d2c7dd5446746758ce59c6e444a391d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:49.877453 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2c7dd5446746758ce59c6e444a391d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:49.879406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:49.928836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2c7dd5446746758ce59c6e444a391d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:49.929486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2c7dd5446746758ce59c6e444a391d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:49.934742 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:49.937681 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2c7dd5446746758ce59c6e444a391d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:49.953562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2c7dd5446746758ce59c6e444a391d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:49.954273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2c7dd5446746758ce59c6e444a391d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:49.967496 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1318/2629] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:49 2022] DELETE /identity/v3/users/9d2c7dd5446746758ce59c6e444a391d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:49.972710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:49.973197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:49.973394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:49.992408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:49.993608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:50.052614 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1312/2630] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:50.062779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:50.064307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:50.128331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba4b47-98de-4090-9d01-7b650e38fc6b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:50.132415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:50.133065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.133343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.133610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.145125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:50.152371 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114a215-bd78-4d7c-9370-f3e32c14af99 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:50.160003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1319/2631] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:50.505604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:50.507199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:50.530942 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a64fc0-d6a4-40a0-bf74-9c13089d3a2f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:50.536281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:50.537282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.537637 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.538032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] PATH_INFO: `/v3/projects/4b84558823124afc8f1ca43bb4c7933a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.539252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b84558823124afc8f1ca43bb4c7933a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:50.541208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:50.591156 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b84558823124afc8f1ca43bb4c7933a', 'request_id': 'req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:50.600767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b84558823124afc8f1ca43bb4c7933a', 'request_id': 'req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:50.607460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b84558823124afc8f1ca43bb4c7933a', 'request_id': 'req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:50.621812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] The token cache is being invalidate because project 4b84558823124afc8f1ca43bb4c7933a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:48:50.622140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:50.622977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c7a93ec7-709b-4a1d-8592-30ce8f45c93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:48:50.624693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1313/2632] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:48:50 2022] DELETE /identity/v3/projects/4b84558823124afc8f1ca43bb4c7933a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:50.629195 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.629508 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.629818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.653673 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:50.654984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:50.747346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1320/2633] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:50.755535 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.755837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.756120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.788095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:50.789219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:50.797998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1314/2634] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:48:50.802010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:50.813291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1f21-61d1-402d-93b5-fefb1ac52f03 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:50.818296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:50.819545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.820095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.820529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.821256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:48:50.821698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:50.823532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:50.838066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1321/2635] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:48:50.842403 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:50.854499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f27863-8a68-4d5c-bfd6-7bcab177ddb5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:50.860975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:50.861798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.863294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.863668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.864483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:50.867017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:50.911150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1315/2636] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:48:50 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:48:50.915262 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:50.927583 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ea9e7-d526-4d9b-81f0-ca1214c69e0b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:50.996192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:50.996728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:50.997015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:50.997285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:50.997920 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:51.000762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:51.009533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:51.026309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1322/2637] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:48:50 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:48:51.030659 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:51.038492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:48:51.042492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840d5b2-9985-4ded-9937-b6896f581a77 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:51.048726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:51.049423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:51.049718 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:51.050251 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:51.051131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:51.052945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:51.063793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1316/2638] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:48:51.067797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:51.079045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eabc72-9253-4888-9dc3-498f67a0e0e2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:51.084070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:51.084875 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:51.085157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:51.085433 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:51.086158 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:51.087755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da0a6b-f5db-4c8a-ba26-7b44e1e98d31 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:51.101872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1323/2639] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:48:51.102988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:51.112793 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cf05-9c9e-4a8f-8480-02e4c4f358f8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:51.117330 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:51.118002 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:51.118283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:51.118552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] PATH_INFO: `/v3/projects/bc414620be4b4769bcad55f600b0b781/users/b3843f973caf4e859cae69334492b9a9/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:51.133127 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc414620be4b4769bcad55f600b0b781, user_id=b3843f973caf4e859cae69334492b9a9, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:51.135744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:51.149461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1317/2640] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:48:51 2022] PUT /identity/v3/projects/bc414620be4b4769bcad55f600b0b781/users/b3843f973caf4e859cae69334492b9a9/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:48:51.159707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:51.159990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:51.160418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:51.190159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] MFA Rules not processed for user `b3843f973caf4e859cae69334492b9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:48:51.191389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:51.274550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1324/2641] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:48:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:48:51.286245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:51.288725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:51.370280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c204c-efe0-45ab-9b31-f9b14d71bc50 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:51.378498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:51.378958 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:51.379239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:51.379536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:51.389603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:51.391103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:51.400936 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1318/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:48:56.646704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:56.648083 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:56.705760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f933-24d4-48e6-9faf-69a16d592106 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:56.709487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:56.712684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:56.713001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:56.713269 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:56.715928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:56.778683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:56.780115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:48:56.790264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1325/2643] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:48:59.931670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:48:59.933710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:48:59.973722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054295-377c-4f98-930d-86424bb285fa service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:48:59.994057 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:48:59.994712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:48:59.994992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:48:59.995318 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] PATH_INFO: `/v3/users/7cf7b00dc3c84466a89ecfcd76bd1a4e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:48:59.996473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf7b00dc3c84466a89ecfcd76bd1a4e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:48:59.998593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.073990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf7b00dc3c84466a89ecfcd76bd1a4e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.074558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf7b00dc3c84466a89ecfcd76bd1a4e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.089660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf7b00dc3c84466a89ecfcd76bd1a4e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.102939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf7b00dc3c84466a89ecfcd76bd1a4e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.103969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d83315a7-431b-4e19-930e-14d0c75436bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf7b00dc3c84466a89ecfcd76bd1a4e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.118018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1319/2644] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:48:59 2022] DELETE /identity/v3/users/7cf7b00dc3c84466a89ecfcd76bd1a4e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:00.291788 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.302558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1c33-fc83-434b-97fa-ece28c933e62 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.320264 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:00.361685 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.362266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.362552 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.362829 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] PATH_INFO: `/v3/projects/c2355d99a24b4f9f961bdd309079d21d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.363973 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2355d99a24b4f9f961bdd309079d21d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.365879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.412734 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2355d99a24b4f9f961bdd309079d21d', 'request_id': 'req-d1245e87-c699-4f83-b3f7-9eb488745f78'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.420092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2355d99a24b4f9f961bdd309079d21d', 'request_id': 'req-d1245e87-c699-4f83-b3f7-9eb488745f78'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.426543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2355d99a24b4f9f961bdd309079d21d', 'request_id': 'req-d1245e87-c699-4f83-b3f7-9eb488745f78'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.436852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] The token cache is being invalidate because project c2355d99a24b4f9f961bdd309079d21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:00.437144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.437779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d1245e87-c699-4f83-b3f7-9eb488745f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:00.439299 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1326/2645] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:00 2022] DELETE /identity/v3/projects/c2355d99a24b4f9f961bdd309079d21d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:00.444162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.444481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.444787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.464304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:00.465494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:00.505682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:00.525924 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1320/2646] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:00.534441 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.534727 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.535001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.554514 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:00.555678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:00.563356 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1327/2647] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:00.567648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.578945 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bbbb8-9be2-4f1c-9fb1-046c6574d91b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.583515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.584116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.584398 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.584671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.585319 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:00.585619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.587244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.599320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1321/2648] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:49:00.603638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.612887 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03811807-e7e5-4a35-a0d4-24506b2ec147 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.617517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.618159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.618445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.618719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.619358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.621263 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.649417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1328/2649] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:00 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:00.653804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.664647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce99d34-0055-49b6-9c59-064516514719 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.731066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.731660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.731938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.732207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.732840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.734868 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.757950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1322/2650] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:00 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:00.761810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.773219 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f26860-0bb9-4df7-9ef1-26ce7873b0f2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.777877 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.778563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.778840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.779110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.779888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.784384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.796726 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1329/2651] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:00.800810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.810966 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29878a48-1c40-4e58-9dae-b52235fcfb6b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.815552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.816139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.816418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.816688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:00.817316 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:00.818896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f28b6-d2de-4ae7-afd8-42c44e795dfd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:00.829561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1323/2652] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:00.834114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:00.844893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42e7b6-239c-4c3f-bccc-35396e76251e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:00.852478 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:00.853535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:00.853928 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:00.854232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] PATH_INFO: `/v3/projects/560a36c4fafd455a86dd59917ff14532/users/ee301e4bc47b4d9c8b1785a6e503fe5c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:01.005092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560a36c4fafd455a86dd59917ff14532, user_id=ee301e4bc47b4d9c8b1785a6e503fe5c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:01.007774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:01.021578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1330/2653] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:00 2022] PUT /identity/v3/projects/560a36c4fafd455a86dd59917ff14532/users/ee301e4bc47b4d9c8b1785a6e503fe5c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:01.033378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:01.034379 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:01.034657 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:01.067082 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] MFA Rules not processed for user `ee301e4bc47b4d9c8b1785a6e503fe5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:01.068515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:01.165899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1324/2654] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:01.176952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:01.178735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:01.234718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:01.240759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f5ec-29b1-4f08-9b3c-8effc374e162 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:01.246090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:01.246937 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:01.247397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:01.247895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:01.266124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:01.266124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:01.270261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1331/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:07.954550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:07.956035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:08.000796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:08.015999 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ce55-6b51-423e-9115-828e677f1f9f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:08.019524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:08.020131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:08.020418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:08.020698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:08.022560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:08.088653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:08.090128 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7bf36-5781-4ea7-b404-49ede135e395 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:08.099835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1325/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:09.786988 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:09.799585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8db58-2718-4477-a44b-fccc4589a126 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:09.804923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:09.805548 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:09.806175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:09.806314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] PATH_INFO: `/v3/users/ee301e4bc47b4d9c8b1785a6e503fe5c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:09.809595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee301e4bc47b4d9c8b1785a6e503fe5c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:09.811576 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:09.871332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee301e4bc47b4d9c8b1785a6e503fe5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:09.872784 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee301e4bc47b4d9c8b1785a6e503fe5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:09.883715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee301e4bc47b4d9c8b1785a6e503fe5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:09.900222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee301e4bc47b4d9c8b1785a6e503fe5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:09.901900 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee301e4bc47b4d9c8b1785a6e503fe5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:09.924189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1332/2657] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:09 2022] DELETE /identity/v3/users/ee301e4bc47b4d9c8b1785a6e503fe5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:09.925019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:09.925471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:09.925760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:09.947772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:09.948992 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:10.030690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1326/2658] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:10.042556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.044636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:10.116499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910467-ead1-404a-b66b-331a566f6578 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.124032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.124584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.125085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.125364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.135657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.137643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e102-78a0-4a24-8283-7fd837d9d212 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:10.148891 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1333/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:10.466725 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.468177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:10.487843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a70a-a7ec-4d18-adfb-5e78fa63026c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.492833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.493476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.493921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.494245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] PATH_INFO: `/v3/projects/560a36c4fafd455a86dd59917ff14532` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.496148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=560a36c4fafd455a86dd59917ff14532)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.498116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:10.555639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560a36c4fafd455a86dd59917ff14532', 'request_id': 'req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:10.567027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560a36c4fafd455a86dd59917ff14532', 'request_id': 'req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:10.578740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560a36c4fafd455a86dd59917ff14532', 'request_id': 'req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:10.589444 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] The token cache is being invalidate because project 560a36c4fafd455a86dd59917ff14532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:10.589722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:10.590445 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18fa92f5-4afa-4661-8ce8-37d66fe6fe4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:10.592240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1327/2660] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:10 2022] DELETE /identity/v3/projects/560a36c4fafd455a86dd59917ff14532 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:10.597418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.597701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.598058 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.617118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:10.618377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:10.681591 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1334/2661] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:10.690085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.690373 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.690647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.712297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:10.713701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:10.722299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1328/2662] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:10.726507 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.734490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:10.741648 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b49f5-4adc-4398-a8cc-df7815507bac None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.747291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.748511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.748893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.749248 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.750556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:10.751108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.752998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:10.769807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1335/2663] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:10.773879 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.783695 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc1ea0-a21b-4ccc-b854-4e4415e0ab7e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.792671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.793446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.793829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.794230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.795028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.797048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:10.803104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:10.834833 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1329/2664] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:10 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:10.839188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.851428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668d10f-7d06-479d-8dea-b3ff4547b3fe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.940266 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.941037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.941427 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.941758 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.942486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.944523 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:10.974237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1336/2665] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:10 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:10.976591 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:10.989456 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28c8b-5561-4b8d-bc49-9e89451054ed admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:10.994764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:10.995685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:10.995963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:10.996473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:10.997112 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:10.998740 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.009712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1330/2666] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:11.013898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.024599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565dded-bded-4d89-96bf-627ccf011d3b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.029374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.030022 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.030314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.030585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.031298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.032878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93de2-b8cc-4175-9794-d443bca4a159 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.043608 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1337/2667] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:11.048766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.058761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9855a50-9def-4332-ac23-3f6a77cae17a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.063988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.064649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.064929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.065199 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] PATH_INFO: `/v3/projects/557f6dd8c1044400a9c8b9d1ce586e7d/users/2600080387df42d48e716991f5dfd6da/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.081790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557f6dd8c1044400a9c8b9d1ce586e7d, user_id=2600080387df42d48e716991f5dfd6da, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.084536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.098011 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1331/2668] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:11 2022] PUT /identity/v3/projects/557f6dd8c1044400a9c8b9d1ce586e7d/users/2600080387df42d48e716991f5dfd6da/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:11.111023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.111312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.111589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.141639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] MFA Rules not processed for user `2600080387df42d48e716991f5dfd6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:11.142898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.241524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1338/2669] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:11.245918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.358861 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7649c-9bc3-4abc-a221-a8e074284dc2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.365060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.365681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.365994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.366282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.366975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.369137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.406346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1332/2670] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:11 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:11.410667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.428170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.431295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61a5b-baa3-4c5f-bc47-ce0bd8efc74b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.435099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.526557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.527211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.527549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.527898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.528450 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.530471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.535666 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324220c-0105-4939-8823-745734fa61b4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.541353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:11.541536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.549240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.549240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.549240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.549240 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.564979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.565474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1339/2671] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:11 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:11.566805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.568296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.569094 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.581536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1333/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:11.582429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.583140 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52caacc-1112-4527-a489-aa53fa3df6bf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.588344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.589207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.589492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.589888 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] PATH_INFO: `/v3/users/f4800b1e92614f72981cbf6bb4279aa6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.590952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4800b1e92614f72981cbf6bb4279aa6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.592909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.596244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea3aa-24f5-49a1-b6ec-4c6df7de0445 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.604370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.605049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.605332 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.605757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.606450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.608041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.620830 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1334/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:11.624668 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.638813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf057-f228-4f89-ab90-3d5ef1334651 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.643578 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.644321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.644667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.645004 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] PATH_INFO: `/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a/users/c39b408112704054b585c0ad2ba756e6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.654196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4800b1e92614f72981cbf6bb4279aa6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:11.654962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4800b1e92614f72981cbf6bb4279aa6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:11.657821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:11.663074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4800b1e92614f72981cbf6bb4279aa6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:11.663655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc42c422bd54b9ea8d0531e310ef70a, user_id=c39b408112704054b585c0ad2ba756e6, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.670325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.676482 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4800b1e92614f72981cbf6bb4279aa6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:11.677351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4800b1e92614f72981cbf6bb4279aa6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:11.684569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1335/2674] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:11 2022] PUT /identity/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a/users/c39b408112704054b585c0ad2ba756e6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:11.688781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.690812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.697913 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1340/2675] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:11 2022] DELETE /identity/v3/users/f4800b1e92614f72981cbf6bb4279aa6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:11.763656 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37d06-ff2a-494a-811b-a7067dcc5653 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.822252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.822867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.823148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.823416 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.824048 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.825648 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.836418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1336/2676] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:11.840517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.851018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0e4f0-28c4-4ec5-bd94-66b77d09dcc8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.855878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.856579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.856882 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.857185 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] PATH_INFO: `/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a/users/c39b408112704054b585c0ad2ba756e6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.859606 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc42c422bd54b9ea8d0531e310ef70a, user_id=c39b408112704054b585c0ad2ba756e6, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.862273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d79f3-0577-441e-a491-28fd40aa0f3a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:11.873146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1341/2677] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:11 2022] PUT /identity/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a/users/c39b408112704054b585c0ad2ba756e6/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:11.883067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:11.883569 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.883864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.884192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.885282 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.907799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af319f-7f82-45ba-8fc8-99c0cc810c6a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:11.928707 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] MFA Rules not processed for user `c39b408112704054b585c0ad2ba756e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:11.929898 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:11.979129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:11.979820 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:11.980040 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:11.980310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] PATH_INFO: `/v3/projects/f871527a6b5c4b58a972839c00fff8d0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:11.981490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f871527a6b5c4b58a972839c00fff8d0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:11.983426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.024041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1342/2678] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:12.030321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:12.036458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.038665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.044363 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f871527a6b5c4b58a972839c00fff8d0', 'request_id': 'req-c33758a2-eab8-4816-9b94-b72bdabadf5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.053781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f871527a6b5c4b58a972839c00fff8d0', 'request_id': 'req-c33758a2-eab8-4816-9b94-b72bdabadf5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.061860 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f871527a6b5c4b58a972839c00fff8d0', 'request_id': 'req-c33758a2-eab8-4816-9b94-b72bdabadf5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.076287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] The token cache is being invalidate because project f871527a6b5c4b58a972839c00fff8d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:12.076620 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.077291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c33758a2-eab8-4816-9b94-b72bdabadf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.079449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1337/2679] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:11 2022] DELETE /identity/v3/projects/f871527a6b5c4b58a972839c00fff8d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:12.083804 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:12.084671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf33-949d-438b-bd45-1a614c0ffa34 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.084671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf33-949d-438b-bd45-1a614c0ffa34 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.084867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cf33-949d-438b-bd45-1a614c0ffa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.106883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e031cf33-949d-438b-bd45-1a614c0ffa34 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:12.108129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e031cf33-949d-438b-bd45-1a614c0ffa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.112160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2581-1664-47d8-9e43-27f869c583b1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.165817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.166556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.166907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.167184 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.168736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1338/2680] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:12.169019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.177394 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.177681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.177973 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.197850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:12.199085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.207533 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1339/2681] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:12.211685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.220911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcabbe-6dab-4b30-a6ee-865934ec8405 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.225662 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.226209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.226491 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.226763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.227412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:12.227714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.229299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.236074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.237500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.241443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1340/2682] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:49:12.245675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.247331 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1343/2683] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:12.256337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344fd3-51e6-4cef-98d4-daee216fe4b9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.261224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.261829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.262145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.262421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.263131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.267192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.302014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1341/2684] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:12.303125 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.315443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9950-8c28-47c9-ae80-b74ba7793aa5 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.406762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.407389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.407665 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.407934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.408577 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.412201 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.439909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1344/2685] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:12.441447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.452806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919ea0-66fb-4354-993c-ebe1cdcd4099 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.460619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.461238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.461516 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.461791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.462470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.464090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.474839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1342/2686] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:12.482607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.489833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e905d-b314-40fa-ba0e-b0db9284d5f8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.494878 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.495483 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.495766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.496057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.496820 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.498774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81c69-d4a1-446f-9644-47842ab228ea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.511879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1345/2687] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:12.514908 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.525227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02ee7f-a0dd-457d-8ba1-8811f0202d99 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.529878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.530586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.530864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.531168 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] PATH_INFO: `/v3/projects/2d36524cdcab48f6ad0b89fd7ebea35d/users/ec9937cb45ce4f5faa2b5973a221af31/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.549343 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d36524cdcab48f6ad0b89fd7ebea35d, user_id=ec9937cb45ce4f5faa2b5973a221af31, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.552149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.573202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1343/2688] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:12 2022] PUT /identity/v3/projects/2d36524cdcab48f6ad0b89fd7ebea35d/users/ec9937cb45ce4f5faa2b5973a221af31/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:12.583372 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.583693 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.584231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.615589 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] MFA Rules not processed for user `ec9937cb45ce4f5faa2b5973a221af31`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:12.616850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.622803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:12.672733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.674701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.691300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1346/2689] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:12.703604 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.705518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.726865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:12.746891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b61f-98ef-4241-8e70-8691c9d6f36c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.752123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.752353 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.752636 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.752907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] PATH_INFO: `/v3/users/2600080387df42d48e716991f5dfd6da` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.754310 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2600080387df42d48e716991f5dfd6da)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.756280 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.785573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5ea7e-ccb5-4378-8a7a-53911ada2fc8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:12.791874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:12.792554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.792841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.793118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.802995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:12.804650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36761169-a61f-4cb0-ad3f-14e06ff55f59 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:12.807901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2600080387df42d48e716991f5dfd6da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.808669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2600080387df42d48e716991f5dfd6da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.814865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1347/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:12.816480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2600080387df42d48e716991f5dfd6da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.829225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2600080387df42d48e716991f5dfd6da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.829994 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2600080387df42d48e716991f5dfd6da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:12.847333 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1344/2691] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:12 2022] DELETE /identity/v3/users/2600080387df42d48e716991f5dfd6da => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:12.851916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:12.852416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:12.852524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:12.872946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:12.874394 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:12.940454 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1348/2692] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:12.950119 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:12.951634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:13.013014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e35d-1430-4954-8137-a3e0893b201e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:13.016873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:13.018965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:13.019284 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:13.019560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:13.029685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:13.031584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:13.041642 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1345/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:13.338400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:13.339848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:13.352413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654e9d8-cc5c-435e-91fc-f5c98f5f24ed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:13.357156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:13.357790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:13.358103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:13.358375 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] PATH_INFO: `/v3/projects/557f6dd8c1044400a9c8b9d1ce586e7d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:13.359801 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557f6dd8c1044400a9c8b9d1ce586e7d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:13.362341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:13.395540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:13.413349 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557f6dd8c1044400a9c8b9d1ce586e7d', 'request_id': 'req-ae68ab11-0602-487f-adb5-e9cd908972c4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.424470 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557f6dd8c1044400a9c8b9d1ce586e7d', 'request_id': 'req-ae68ab11-0602-487f-adb5-e9cd908972c4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.431815 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557f6dd8c1044400a9c8b9d1ce586e7d', 'request_id': 'req-ae68ab11-0602-487f-adb5-e9cd908972c4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.443336 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] The token cache is being invalidate because project 557f6dd8c1044400a9c8b9d1ce586e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:13.443623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.444395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.446173 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1349/2694] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:13 2022] DELETE /identity/v3/projects/557f6dd8c1044400a9c8b9d1ce586e7d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:13.449998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:13.462640 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486bddf-90de-48cc-bb3c-67693362b0d1 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:13.521790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:13.522366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:13.522649 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:13.522927 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] PATH_INFO: `/v3/users/c39b408112704054b585c0ad2ba756e6` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:13.524038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39b408112704054b585c0ad2ba756e6)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:13.525975 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:13.536457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:13.587597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39b408112704054b585c0ad2ba756e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.588286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39b408112704054b585c0ad2ba756e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.595562 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39b408112704054b585c0ad2ba756e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.610275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39b408112704054b585c0ad2ba756e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.611015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3480de43-3437-4ee0-8bf4-80d415e04379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39b408112704054b585c0ad2ba756e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:13.625694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1346/2695] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:13 2022] DELETE /identity/v3/users/c39b408112704054b585c0ad2ba756e6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:13.911097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:13.913505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:13.933270 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68ab11-0602-487f-adb5-e9cd908972c4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:13.994644 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:13.995276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:13.995554 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:13.995827 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] PATH_INFO: `/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:13.996936 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc42c422bd54b9ea8d0531e310ef70a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:13.998881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.050292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc42c422bd54b9ea8d0531e310ef70a', 'request_id': 'req-58d06974-810a-4e5d-8bc4-906a229900e0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:14.057698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc42c422bd54b9ea8d0531e310ef70a', 'request_id': 'req-58d06974-810a-4e5d-8bc4-906a229900e0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:14.064760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc42c422bd54b9ea8d0531e310ef70a', 'request_id': 'req-58d06974-810a-4e5d-8bc4-906a229900e0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:14.076100 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] The token cache is being invalidate because project ddc42c422bd54b9ea8d0531e310ef70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:14.076409 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:14.077060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-58d06974-810a-4e5d-8bc4-906a229900e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:14.078601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1350/2696] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:13 2022] DELETE /identity/v3/projects/ddc42c422bd54b9ea8d0531e310ef70a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:14.083555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.084031 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.084153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.105436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:14.106702 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:14.170510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1347/2697] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:14.179291 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.179574 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.179848 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.201774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:14.203078 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:14.211102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1351/2698] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:14.215651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.225979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d819f3-5478-4f63-86b0-c884352174e5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.230572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.231203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.231482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.231756 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.232401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:14.232703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.235241 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.251499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1348/2699] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:14.252756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.262406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8546de-4876-4f65-84af-0495b68f1b51 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.267070 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.267677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.267959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.268224 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.269981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.271254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.317684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1352/2700] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:14.319019 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.329463 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dfa7b-0e9d-4d4e-9df5-6d6c7bbdffe2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.389213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.390111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.390505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.390849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.391664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.394183 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.418122 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1349/2701] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:14.424155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.433221 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf99b7-4fd2-4d2e-8a6c-8ab7530b6d82 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.437906 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.438533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.438803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.439068 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.439703 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.441273 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.451976 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1353/2702] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:14.456252 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.462888 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:14.467094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db88c04-0975-4891-bc3c-41dedebc1b82 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.482225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.482891 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.483229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.483474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.484899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.486658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc9be6-5349-4d09-8bd2-9eb2ca0d4a06 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.500919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1350/2703] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:14.505190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.516108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf5ce-1d77-462b-b359-b9bcb10bff29 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.521924 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.522610 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.522931 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.523213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] PATH_INFO: `/v3/projects/7159ea1409b64530987de40e2024d484/users/aa7f31af2c674e8b8406369eaf57902a/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.533474 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:14.551697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7159ea1409b64530987de40e2024d484, user_id=aa7f31af2c674e8b8406369eaf57902a, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.554721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.568403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1354/2704] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:14 2022] PUT /identity/v3/projects/7159ea1409b64530987de40e2024d484/users/aa7f31af2c674e8b8406369eaf57902a/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:14.580185 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.580532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.580808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.610630 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] MFA Rules not processed for user `aa7f31af2c674e8b8406369eaf57902a`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:14.612121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:14.677283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1351/2705] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:14.682099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.746459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187370e9-6102-4d50-9faf-afe3c90bde2f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.751134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.751736 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.752011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.752277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.752915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.754850 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.780943 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1355/2706] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:14.785651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.796671 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74756f45-809b-498f-80c2-dbe041b221b7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.853857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.854432 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.854710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.854987 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.855608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.857536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.879409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1352/2707] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:14 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:14.883527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.894112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db561b-7dad-4273-97b8-945fd19018ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.898692 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.899290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.899607 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.899879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.900578 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.902211 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.913779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1356/2708] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:14.918634 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.928878 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed11fd-e747-4093-a415-779547d24574 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:14.933557 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:14.934238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:14.934524 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:14.934800 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] PATH_INFO: `/v3/projects/ee34e917266e4eed8e91ca8d61a0e934/users/87c7c47e91b9482490e3c14734aae94c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:14.949597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee34e917266e4eed8e91ca8d61a0e934, user_id=87c7c47e91b9482490e3c14734aae94c, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:14.952537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:14.966712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1353/2709] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:14 2022] PUT /identity/v3/projects/ee34e917266e4eed8e91ca8d61a0e934/users/87c7c47e91b9482490e3c14734aae94c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:14.971370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:14.981424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6654e1-02fe-4c28-aa21-abd9233b8bd3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:15.036860 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:15.037473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:15.038040 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:15.038319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:15.038963 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:15.040619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f4c4f-41a5-495d-a508-fc5806ea1089 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:15.050455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1357/2710] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:15.054606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:15.065515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53071d-d490-4d3d-8d68-a7f0c88b1749 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:15.070109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:15.070762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:15.071042 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:15.071315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] PATH_INFO: `/v3/projects/ee34e917266e4eed8e91ca8d61a0e934/users/87c7c47e91b9482490e3c14734aae94c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:15.073214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee34e917266e4eed8e91ca8d61a0e934, user_id=87c7c47e91b9482490e3c14734aae94c, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:15.075882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:15.086789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1354/2711] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:15 2022] PUT /identity/v3/projects/ee34e917266e4eed8e91ca8d61a0e934/users/87c7c47e91b9482490e3c14734aae94c/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:15.097037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:15.097355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:15.097636 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:15.126545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] MFA Rules not processed for user `87c7c47e91b9482490e3c14734aae94c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:15.127682 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:15.169025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:15.196918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1358/2712] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:15.207852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:15.209561 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:15.250368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:15.269034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cea2-046d-443c-85e6-ef20f0960054 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:15.272735 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:15.273342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:15.273626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:15.273896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:15.283813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:15.285267 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef614-e6f7-4f5a-a1a9-dcf87e8218eb service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:15.295466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1355/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:16.674340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:16.736121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84669f1-9da1-4f3e-8993-41df2ebdd2dc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:16.740594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:16.741392 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:16.741679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:16.741961 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] PATH_INFO: `/v3/users/aa7f31af2c674e8b8406369eaf57902a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:16.743202 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7f31af2c674e8b8406369eaf57902a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:16.745149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:16.793573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7f31af2c674e8b8406369eaf57902a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:16.794244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7f31af2c674e8b8406369eaf57902a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:16.801189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7f31af2c674e8b8406369eaf57902a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:16.813832 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7f31af2c674e8b8406369eaf57902a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:16.814535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7f31af2c674e8b8406369eaf57902a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:16.837214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1359/2714] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:16 2022] DELETE /identity/v3/users/aa7f31af2c674e8b8406369eaf57902a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:16.838518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:16.838518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:16.838518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:16.855814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:16.857067 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:16.926929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1356/2715] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:16.936790 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:16.938876 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:16.999406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9a1f-f392-4a9e-9970-1b31b989eda4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:17.003640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:17.004245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:17.004592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:17.004869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:17.014048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:17.015587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:17.021003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:17.030240 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1360/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:17.302790 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:17.305167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:17.319181 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356da30-ef47-4432-a14f-122175c0a6a8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:17.325707 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:17.326377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:17.326665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:17.326939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] PATH_INFO: `/v3/projects/7159ea1409b64530987de40e2024d484` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:17.328068 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7159ea1409b64530987de40e2024d484)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:17.330708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:17.378694 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7159ea1409b64530987de40e2024d484', 'request_id': 'req-438dea93-c569-4989-b4e2-307cec5e07da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.386189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7159ea1409b64530987de40e2024d484', 'request_id': 'req-438dea93-c569-4989-b4e2-307cec5e07da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.392587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7159ea1409b64530987de40e2024d484', 'request_id': 'req-438dea93-c569-4989-b4e2-307cec5e07da'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.402693 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] The token cache is being invalidate because project 7159ea1409b64530987de40e2024d484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:17.402982 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.403613 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.405079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1357/2717] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:17 2022] DELETE /identity/v3/projects/7159ea1409b64530987de40e2024d484 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:17.409615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:17.419803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64a13c-bb5e-4cd0-a1f0-34c50a2ef0e7 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:17.475506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:17.476128 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:17.476406 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:17.476684 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] PATH_INFO: `/v3/users/87c7c47e91b9482490e3c14734aae94c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:17.477789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c7c47e91b9482490e3c14734aae94c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:17.479731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:17.524808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c7c47e91b9482490e3c14734aae94c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.525463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c7c47e91b9482490e3c14734aae94c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.532774 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c7c47e91b9482490e3c14734aae94c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.544737 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c7c47e91b9482490e3c14734aae94c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.545377 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9a66762e-d20a-483c-9cab-52d1e5014e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c7c47e91b9482490e3c14734aae94c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.558675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1361/2718] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:17 2022] DELETE /identity/v3/users/87c7c47e91b9482490e3c14734aae94c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:17.830880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:17.832303 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:17.847049 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dea93-c569-4989-b4e2-307cec5e07da admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:17.903766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:17.904731 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:17.905016 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:17.905294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] PATH_INFO: `/v3/projects/ee34e917266e4eed8e91ca8d61a0e934` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:17.907153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee34e917266e4eed8e91ca8d61a0e934)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:17.909187 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:17.911523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:17.959902 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee34e917266e4eed8e91ca8d61a0e934', 'request_id': 'req-786ec2db-8561-424d-89a5-6cfc613896ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.967678 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee34e917266e4eed8e91ca8d61a0e934', 'request_id': 'req-786ec2db-8561-424d-89a5-6cfc613896ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.974753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee34e917266e4eed8e91ca8d61a0e934', 'request_id': 'req-786ec2db-8561-424d-89a5-6cfc613896ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.986027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] The token cache is being invalidate because project ee34e917266e4eed8e91ca8d61a0e934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:17.986320 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.986990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-786ec2db-8561-424d-89a5-6cfc613896ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:17.988472 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1358/2719] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:17 2022] DELETE /identity/v3/projects/ee34e917266e4eed8e91ca8d61a0e934 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:17.993676 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:17.994153 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:17.994257 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.014725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.018085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.088769 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1362/2720] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:18.096921 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.097275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.097625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.117587 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.117775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.119009 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.119142 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.127474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1359/2721] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:18.131440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.131779 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1d416-7d2d-4104-b9bd-a78316806db1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.136431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.137086 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.137321 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.137592 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] PATH_INFO: `/v3/users/ec9937cb45ce4f5faa2b5973a221af31` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.138792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9937cb45ce4f5faa2b5973a221af31)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.140344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec303db-ad54-43ee-9160-2981f949c7bd None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.141312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.145550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.146162 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.146446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.146719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.147608 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:18.147730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.149227 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.155562 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:18.165076 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1360/2722] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:49:18.166433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.178158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f958-be60-4add-b282-239434ae0496 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.182753 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.183339 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.183625 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.183897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.184547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.186490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.190958 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9937cb45ce4f5faa2b5973a221af31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.191640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9937cb45ce4f5faa2b5973a221af31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.198952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9937cb45ce4f5faa2b5973a221af31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.213041 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9937cb45ce4f5faa2b5973a221af31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.213668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-096389c5-d373-4b95-84b2-4481b1cb04ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9937cb45ce4f5faa2b5973a221af31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.216008 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1361/2723] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:18.220369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.222063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.230045 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1363/2724] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:18 2022] DELETE /identity/v3/users/ec9937cb45ce4f5faa2b5973a221af31 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:18.234420 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.234712 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.234981 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.254066 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.255261 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.296521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903987-b1c0-40f5-befc-1f8c220736ae admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.319294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1364/2725] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:18.330513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.331857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.347764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:18.354502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.355481 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.355947 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.356540 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.357739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.360757 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.387670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1362/2726] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:18.388779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.392558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ca783-40b7-4e3c-9700-df327f983bdd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.396679 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.397285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.397565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.397841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.398408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc9a2-7179-4dd2-991a-e90387429526 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.402923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.403498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.403779 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.404050 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.404679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.406370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.407228 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.408759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.416919 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1363/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:18.419752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1365/2728] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:18.420805 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.431743 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8767b-ed58-4cce-b119-f3e32c30ec9f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.436609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.437233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.438194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.438476 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.439213 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.440859 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197794a-937a-4ab1-9e5c-159d4bf1193e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.453060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1364/2729] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:18.457518 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.467677 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d4c9-a756-4a30-b54d-672148d60841 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.473118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.473865 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.474183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.474461 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] PATH_INFO: `/v3/projects/00868525f2e84531809afad3a8b960c2/users/30bda7d284a44e0f8b11e54605bb983c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.491797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00868525f2e84531809afad3a8b960c2, user_id=30bda7d284a44e0f8b11e54605bb983c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.494721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.509710 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1366/2730] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:18 2022] PUT /identity/v3/projects/00868525f2e84531809afad3a8b960c2/users/30bda7d284a44e0f8b11e54605bb983c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:18.522174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.522475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.522788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.554849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] MFA Rules not processed for user `30bda7d284a44e0f8b11e54605bb983c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.556075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.634061 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1365/2731] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:18.638922 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.653213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:18.707467 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.708917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.712075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1412-b48a-4def-9db1-25025393c7b0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.717455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.718355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.718448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.719250 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.719892 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.721798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.733579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753fe34-bc12-4e9d-b9b0-5360e52ce7b2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.739461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.740388 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.740842 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.741231 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] PATH_INFO: `/v3/projects/2d36524cdcab48f6ad0b89fd7ebea35d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.742669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d36524cdcab48f6ad0b89fd7ebea35d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.745027 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.755655 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1367/2732] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:18.756798 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.804951 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d36524cdcab48f6ad0b89fd7ebea35d', 'request_id': 'req-fe997d9b-0dd1-4bc3-b0c4-836dba037016'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.816446 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d36524cdcab48f6ad0b89fd7ebea35d', 'request_id': 'req-fe997d9b-0dd1-4bc3-b0c4-836dba037016'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.823827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d36524cdcab48f6ad0b89fd7ebea35d', 'request_id': 'req-fe997d9b-0dd1-4bc3-b0c4-836dba037016'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.827488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce10a-35ff-471f-bdc0-5f36365b478d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.835674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] The token cache is being invalidate because project 2d36524cdcab48f6ad0b89fd7ebea35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:18.835983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.837603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fe997d9b-0dd1-4bc3-b0c4-836dba037016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:18.839337 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1366/2733] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:18 2022] DELETE /identity/v3/projects/2d36524cdcab48f6ad0b89fd7ebea35d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:18.844741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad84d-1b6c-4840-a4ee-d4e636ffc80e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.845250 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad84d-1b6c-4840-a4ee-d4e636ffc80e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.845804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad84d-1b6c-4840-a4ee-d4e636ffc80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.872904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5e0ad84d-1b6c-4840-a4ee-d4e636ffc80e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.874178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5e0ad84d-1b6c-4840-a4ee-d4e636ffc80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.898203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.898324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.898856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.899147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.899789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.903431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.919151 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:18.931796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1368/2734] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:18.936141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.938516 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.952841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768320-c96c-45af-817f-9d9c78b76554 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:18.963133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1367/2735] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:18.966026 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:18.966762 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.967054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.967334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.968343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:18.970678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:18.971271 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:18.971568 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:18.971848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:18.985000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1369/2736] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:18.986340 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:18.995483 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:18.997000 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:18.997120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c69f08-2b3b-4315-ad69-49282cd44574 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.002374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.003003 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.003253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.003555 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.004289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.005501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1368/2737] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:19.005851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.009762 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.023135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1370/2738] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:19.023322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca746e9-981f-4344-ab48-9040c3bf3a37 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.024797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.025322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.026135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.026506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.026850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.027787 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:19.028083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.030024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.036566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60323-6358-49fe-be5a-ab787dacf933 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.042724 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.046604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1369/2739] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:19.047391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.047391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.047391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] PATH_INFO: `/v3/projects/03e910dfb6ff4587930d6823ad234867/users/4fa0b25bb82346bcb1027a67c5f125dd/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.049641 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.053383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:19.060153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1a7ec-5d3f-4149-a4b8-7b89244add9f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.062359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e910dfb6ff4587930d6823ad234867, user_id=4fa0b25bb82346bcb1027a67c5f125dd, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.065074 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.065801 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.065930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807bf80-d7b4-4df6-b272-41349c11c3d5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.066146 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.066522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.067214 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.069334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.082521 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1371/2740] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:19 2022] PUT /identity/v3/projects/03e910dfb6ff4587930d6823ad234867/users/4fa0b25bb82346bcb1027a67c5f125dd/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:19.092545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.093037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.093380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.108674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1370/2741] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:19.109965 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.124413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] MFA Rules not processed for user `4fa0b25bb82346bcb1027a67c5f125dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:19.126000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:19.183552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adab03-05bf-4913-8c05-8d4b5e4d5d77 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.188418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.189109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.189460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.189804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.190546 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.192610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.198029 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1372/2742] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:19.202857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.214866 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666381a-161c-4406-b30a-974c9d60a51f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.220381 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.223814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.224043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1371/2743] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:19.224149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.224149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.224149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.224511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.224632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.235351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2026e3-cd99-410a-a299-94f230d2ff5d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.242970 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.243698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.243889 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.245028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.245627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.247703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.260725 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1373/2744] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:19.262963 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1372/2745] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:19.264698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.269266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.293229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fbb9e-b801-4d33-be8d-70e226e30de3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.377362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd6620-7049-475e-84b6-bfa36aeceb24 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.382907 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.383538 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.383937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.384060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.384223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.384823 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.384959 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.385103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.385494 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.386256 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.386606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.388342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.398301 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1373/2746] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:19.402418 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.412149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1374/2747] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:19.413197 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c970cf-8b5d-4c37-8e53-87da07013d40 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.416032 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.418291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.418943 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.419225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.419495 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] PATH_INFO: `/v3/projects/c5ed6bfde4594de9b78bd6f39ceef136/users/c085519a354b40498f2d5d709073f810/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.426837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d0db-c7db-4348-b1cc-ffbe3e87d1a7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.428792 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:19.432332 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.432968 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.433249 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.433527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.434214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.436222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.437421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ed6bfde4594de9b78bd6f39ceef136, user_id=c085519a354b40498f2d5d709073f810, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.440313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352409-3151-471a-bce4-35ad2190af2a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.447107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1375/2748] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:19.451505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.454313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1374/2749] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:19 2022] PUT /identity/v3/projects/c5ed6bfde4594de9b78bd6f39ceef136/users/c085519a354b40498f2d5d709073f810/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:19.464296 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14843461-6c80-40aa-8563-0f4d3bd6a113 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.465719 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.466066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.466350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.494014 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] MFA Rules not processed for user `c085519a354b40498f2d5d709073f810`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:19.494977 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:19.495140 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:19.524232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.525167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.525620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.525907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] PATH_INFO: `/v3/projects/14cde902b8c6400a8db5a75b36b35d80/users/348ddb93317546be89292b5ec3194fa5/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.540412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cde902b8c6400a8db5a75b36b35d80, user_id=348ddb93317546be89292b5ec3194fa5, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.543107 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.555984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1376/2750] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:19 2022] PUT /identity/v3/projects/14cde902b8c6400a8db5a75b36b35d80/users/348ddb93317546be89292b5ec3194fa5/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:19.559809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.561615 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1375/2751] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:19.566314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.576294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7df0a-8919-4bf7-a42a-b168c63924c1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.628612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03e92b-0415-4cff-bc0d-56ff0db6a4a5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.634151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.635005 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.635448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.636020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.637537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.639231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.642597 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.643586 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.643873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.644147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.644785 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.646909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.652789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1377/2752] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:19.657015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.667118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4c3dd-b8bf-487c-b7cd-01293b7d9a83 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.672525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.673234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.673527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.673799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] PATH_INFO: `/v3/projects/14cde902b8c6400a8db5a75b36b35d80/users/348ddb93317546be89292b5ec3194fa5/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.675899 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cde902b8c6400a8db5a75b36b35d80, user_id=348ddb93317546be89292b5ec3194fa5, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.678759 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b13733-de97-4a40-92b6-318e51f1a622 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.682869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1376/2753] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:19.684248 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.690109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1378/2754] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:19 2022] PUT /identity/v3/projects/14cde902b8c6400a8db5a75b36b35d80/users/348ddb93317546be89292b5ec3194fa5/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:19.700881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.701175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.701456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.731059 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] MFA Rules not processed for user `348ddb93317546be89292b5ec3194fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:19.732439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:19.747981 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7b0f6-9a28-4e95-88e9-d20d3a5c4cb4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.753772 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:19.802362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1379/2755] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:19.805246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.805883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.806198 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.806473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.807111 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.809060 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.815073 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.816426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:19.834748 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1377/2756] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:19 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:19.835892 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.845106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:19.846001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30c5a-d38e-49ae-96e0-d49db702812d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.851708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.852315 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.852603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.852876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.853525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.855148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.868723 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1378/2757] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:19.869722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.877346 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9e85e-b9ba-4ebe-8cbd-08379521bd40 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.879813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39f26-8854-4b5b-b713-3e30d9df7a1f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.880984 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.881584 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.881861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.882170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.883983 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:19.884439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.885064 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.885350 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.885628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] PATH_INFO: `/v3/projects/af111a120f3749f8a542da0ccbb9e1f9/users/135604c0356f4509879376dd699e49ff/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.901201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af111a120f3749f8a542da0ccbb9e1f9, user_id=135604c0356f4509879376dd699e49ff, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.904090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.919032 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1379/2758] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:19 2022] PUT /identity/v3/projects/af111a120f3749f8a542da0ccbb9e1f9/users/135604c0356f4509879376dd699e49ff/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:19.923211 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:19.952995 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.954585 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:19.963713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1380/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:19.989012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f642732-bde3-4468-8ec0-1a1fb7a40a63 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:19.993688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:19.994321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:19.994598 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:19.994854 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:19.995493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:19.997159 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73183aa-7805-492b-a3c7-d2f7830d7ccc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:20.007340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1380/2760] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:20.011485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:20.022374 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f467a5-1ea3-4a35-828c-88ca97834b9c service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:20.026985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:20.027624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:20.027903 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:20.028177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] PATH_INFO: `/v3/projects/af111a120f3749f8a542da0ccbb9e1f9/users/135604c0356f4509879376dd699e49ff/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:20.030120 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af111a120f3749f8a542da0ccbb9e1f9, user_id=135604c0356f4509879376dd699e49ff, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:20.032851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:20.043700 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1381/2761] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:20 2022] PUT /identity/v3/projects/af111a120f3749f8a542da0ccbb9e1f9/users/135604c0356f4509879376dd699e49ff/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:20.054685 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:20.054974 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:20.055247 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:20.084775 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] MFA Rules not processed for user `135604c0356f4509879376dd699e49ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:20.086412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:20.136338 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:20.159148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1381/2762] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:20.173110 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:20.175115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:20.240509 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a006-851a-4163-a810-1101a56c23d8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:20.244196 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:20.244809 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:20.245085 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:20.245362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:20.256306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:20.257678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:20.280190 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1382/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:20.356555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:20.367600 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c6707-3858-4a1e-ba15-fee3faf4a2e1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:20.371415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:20.372125 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:20.372479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:20.372873 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:20.431005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:20.432433 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:20.441758 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1382/2764] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:21.479512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:21.488718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20bfa7-3b04-4bcb-939b-f5e6f6727370 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:21.492329 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:21.492911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:21.493194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:21.493468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:21.554524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:21.555893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:21.565761 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1383/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:22.165184 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:22.173991 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507d2-944b-475f-9c77-006bb445cd7e service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:22.177643 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:22.178305 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:22.178627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:22.178837 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:22.239436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:22.240869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48577acc-fb2f-4a7a-a444-2c7f7e3cbe41 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:22.250810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1383/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:23.304254 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:23.313416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:23.368564 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a92c-dead-4c7f-a771-62df481c00a5 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:23.373098 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:23.373718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:23.374025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:23.374301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] PATH_INFO: `/v3/users/c085519a354b40498f2d5d709073f810` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:23.375907 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c085519a354b40498f2d5d709073f810)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:23.377855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:23.426445 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c085519a354b40498f2d5d709073f810'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:23.427319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c085519a354b40498f2d5d709073f810'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:23.434472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c085519a354b40498f2d5d709073f810'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:23.447863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c085519a354b40498f2d5d709073f810'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:23.448512 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c085519a354b40498f2d5d709073f810'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:23.462302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1384/2767] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:23 2022] DELETE /identity/v3/users/c085519a354b40498f2d5d709073f810 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:23.467015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:23.467515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:23.467638 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:23.487099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:23.488291 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:23.547455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1384/2768] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:23.557722 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:23.559341 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:23.623405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae3f3-7eb6-42c1-ad44-9b283eef8f32 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:23.627732 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:23.628281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:23.628558 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:23.628828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:23.640115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:23.641930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:23.653255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1385/2769] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:23.931679 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:23.934789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:23.947944 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef792-f97b-41a6-a43f-2e161131b586 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:23.950209 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:23.953296 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:23.953451 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:23.954153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:23.954443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:23.954764 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] PATH_INFO: `/v3/projects/c5ed6bfde4594de9b78bd6f39ceef136` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:23.955935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ed6bfde4594de9b78bd6f39ceef136)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:23.958021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:23.970897 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:23.972285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db0b3d-8b72-4899-87c2-f9c77b60ceb3 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:23.977188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:23.977838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:23.978147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:23.978417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] PATH_INFO: `/v3/users/b3843f973caf4e859cae69334492b9a9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:23.979524 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3843f973caf4e859cae69334492b9a9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:23.981416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.004852 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:24.011595 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ed6bfde4594de9b78bd6f39ceef136', 'request_id': 'req-56a08fb1-fdfa-4a5b-9859-19260df3032b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.019808 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ed6bfde4594de9b78bd6f39ceef136', 'request_id': 'req-56a08fb1-fdfa-4a5b-9859-19260df3032b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.026676 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ed6bfde4594de9b78bd6f39ceef136', 'request_id': 'req-56a08fb1-fdfa-4a5b-9859-19260df3032b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.032532 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3843f973caf4e859cae69334492b9a9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.033271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3843f973caf4e859cae69334492b9a9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.038018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] The token cache is being invalidate because project c5ed6bfde4594de9b78bd6f39ceef136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:24.038558 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.039189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.040869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1385/2770] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:23 2022] DELETE /identity/v3/projects/c5ed6bfde4594de9b78bd6f39ceef136 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:24.041617 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3843f973caf4e859cae69334492b9a9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.044452 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.045827 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.054851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3843f973caf4e859cae69334492b9a9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.055522 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-65eef008-c7e4-4607-bf48-c8fb56c166d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3843f973caf4e859cae69334492b9a9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.069307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1386/2771] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:23 2022] DELETE /identity/v3/users/b3843f973caf4e859cae69334492b9a9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:24.073768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.074076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.074354 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.092923 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:24.094661 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.117697 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08fb1-fdfa-4a5b-9859-19260df3032b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.155308 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1387/2772] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:24.165637 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.167116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.172895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.173526 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.173803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.174106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] PATH_INFO: `/v3/users/135604c0356f4509879376dd699e49ff` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.175351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135604c0356f4509879376dd699e49ff)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.177255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.226136 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135604c0356f4509879376dd699e49ff'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.226797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135604c0356f4509879376dd699e49ff'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.226970 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d834-2134-4cd6-af8c-f9a46f3143d9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.228867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:24.231543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.232150 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.232435 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.232735 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.235545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.236293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135604c0356f4509879376dd699e49ff'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.247953 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.248515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135604c0356f4509879376dd699e49ff'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.249221 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135604c0356f4509879376dd699e49ff'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.249382 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.259415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1388/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:24.262542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1386/2774] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:24 2022] DELETE /identity/v3/users/135604c0356f4509879376dd699e49ff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:24.527993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.529490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.540294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.541814 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.548399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c127-616d-4a09-9537-cf364616d7d3 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.594447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:24.611225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.611854 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.612134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.612412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] PATH_INFO: `/v3/projects/bc414620be4b4769bcad55f600b0b781` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.613527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc414620be4b4769bcad55f600b0b781)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.615456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.635046 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1207ff-8e6c-46a3-b025-6736cde5f043 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.639737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.641006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.641294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.641692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] PATH_INFO: `/v3/projects/af111a120f3749f8a542da0ccbb9e1f9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.642829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af111a120f3749f8a542da0ccbb9e1f9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.644930 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.667132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc414620be4b4769bcad55f600b0b781', 'request_id': 'req-fca90d23-efa3-4607-ad81-987dd1ce5000'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.675743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc414620be4b4769bcad55f600b0b781', 'request_id': 'req-fca90d23-efa3-4607-ad81-987dd1ce5000'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.682563 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc414620be4b4769bcad55f600b0b781', 'request_id': 'req-fca90d23-efa3-4607-ad81-987dd1ce5000'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.694149 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] The token cache is being invalidate because project bc414620be4b4769bcad55f600b0b781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:24.694540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.695282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fca90d23-efa3-4607-ad81-987dd1ce5000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.696805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1389/2775] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:24 2022] DELETE /identity/v3/projects/bc414620be4b4769bcad55f600b0b781 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:24.697895 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af111a120f3749f8a542da0ccbb9e1f9', 'request_id': 'req-20ae6798-36c3-49ff-9e12-2a4448b35232'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.701598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebce0-8263-41f4-98a2-b322f0a59002 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.701965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebce0-8263-41f4-98a2-b322f0a59002 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.702324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ebce0-8263-41f4-98a2-b322f0a59002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.709594 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af111a120f3749f8a542da0ccbb9e1f9', 'request_id': 'req-20ae6798-36c3-49ff-9e12-2a4448b35232'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.717006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af111a120f3749f8a542da0ccbb9e1f9', 'request_id': 'req-20ae6798-36c3-49ff-9e12-2a4448b35232'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.725624 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-608ebce0-8263-41f4-98a2-b322f0a59002 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:24.726842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-608ebce0-8263-41f4-98a2-b322f0a59002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.730077 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] The token cache is being invalidate because project af111a120f3749f8a542da0ccbb9e1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:24.730370 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.731237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-20ae6798-36c3-49ff-9e12-2a4448b35232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:24.733480 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1387/2776] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:24 2022] DELETE /identity/v3/projects/af111a120f3749f8a542da0ccbb9e1f9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:24.739391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639764-2890-43fa-b2b4-fc1a04fb8326 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.739877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639764-2890-43fa-b2b4-fc1a04fb8326 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.740203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639764-2890-43fa-b2b4-fc1a04fb8326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.762584 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fb639764-2890-43fa-b2b4-fc1a04fb8326 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:24.763874 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fb639764-2890-43fa-b2b4-fc1a04fb8326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.801807 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1390/2777] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:24.809314 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.809601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.809872 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.823654 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:24.835229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1388/2778] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:24.842813 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:24.843052 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.844998 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.845734 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.846730 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.852448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1391/2779] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:24.856373 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.866527 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25e09-7d1d-4a9e-8a0c-475b73657ab6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.870469 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:24.871658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:24.873840 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.874530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.875328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.875600 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.876244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:24.876545 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.878175 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.883669 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1389/2780] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:24.884631 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.894941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1392/2781] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:49:24.896166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.897865 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe354a-8e3e-4967-9503-4de744f8607b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.903624 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.904334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.904705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.905066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.905769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:24.906224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.906645 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09644-80ec-42ec-9136-adc1bdf9b0ff admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.907916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.912459 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.913557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.913994 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.914359 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.915097 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.917505 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.923530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1390/2782] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:24.927705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.939290 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae6bd-9538-4141-b957-2da002ec9518 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:24.944120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:24.944850 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:24.945135 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:24.945583 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:24.946244 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:24.948238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:24.951506 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1393/2783] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:24.956944 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:24.980828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1391/2784] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:24.982193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.001868 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:25.032853 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727526-2caf-42e7-87bf-43ec32ea6fbc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.055226 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63993df-30b7-4452-bd90-f1c744215630 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.070555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.070555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.070555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.070555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.071229 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.072192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.097984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1392/2785] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:25.101243 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.115074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.115814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.116178 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.116572 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.117203 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.119370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.119783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7414f84-0fd3-425f-a147-976bb111c78e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.126771 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.127482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.127840 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.128193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.128839 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.130488 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.141148 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1394/2786] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:24 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:25.144582 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1393/2787] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:25.145135 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.148354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.154651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e632d-0a6e-4bc6-8e83-46d23d170236 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.158150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e7aa9-40a6-4d16-b50d-47091b5b7d19 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.159399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.159978 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.160255 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.160525 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.161157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.162772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.162900 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.163701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.163985 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.164263 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.164917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.166499 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.177418 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1395/2788] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:25.178399 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.180660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1394/2789] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:25.184609 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.189713 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cc01-4c60-48c3-a3da-033791d6807a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.194530 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.194917 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c6bf0-8239-40a5-8da9-4493854b5e82 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.195115 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.195431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.195705 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.196362 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.197927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.199733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.200690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.200971 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.201358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] PATH_INFO: `/v3/projects/5ae75bcc42f34e06be9e51a0c7523d0e/users/cb590a96572d47abbe2cf21f244d8664/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.208838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1396/2790] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:25.212716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.215796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae75bcc42f34e06be9e51a0c7523d0e, user_id=cb590a96572d47abbe2cf21f244d8664, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.218460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a12e-2077-40d5-913c-d8626d4c2692 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.222867 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc4354-4eef-43cf-8a9a-66e1c48c3ac7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.228272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.229197 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.229535 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.229817 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] PATH_INFO: `/v3/projects/161211850ccd43b1ae43815d532e2c06/users/115dfecd87314e1ba2d1775eba6c0f16/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.233755 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1395/2791] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:25 2022] PUT /identity/v3/projects/5ae75bcc42f34e06be9e51a0c7523d0e/users/cb590a96572d47abbe2cf21f244d8664/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:25.244728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.245001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.245287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.245407 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161211850ccd43b1ae43815d532e2c06, user_id=115dfecd87314e1ba2d1775eba6c0f16, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.248099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973422c-c358-4d7a-bcb9-b2d5070506b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.265226 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1397/2792] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:25 2022] PUT /identity/v3/projects/161211850ccd43b1ae43815d532e2c06/users/115dfecd87314e1ba2d1775eba6c0f16/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:25.269654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.269814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.270155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.277783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] MFA Rules not processed for user `cb590a96572d47abbe2cf21f244d8664`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:25.279152 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:25.290319 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:25.291640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:25.331829 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:25.355189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1396/2793] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:25.359033 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1398/2794] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:25.360738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.367549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.368980 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:25.371545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6488e-73f1-41e4-9095-8d0244bf1e71 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.376883 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.377482 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.377760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.378066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.378781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.380664 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.397421 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:25.409515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1397/2795] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:25 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:25.413632 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.427993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f2ffb-3639-4698-98ac-de31e0b969dd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.475340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ff78b-d1da-49e4-868b-0190d8ffd250 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.478387 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.478996 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.479276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.479553 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.480118 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.480712 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.480996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.481266 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.481898 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.483828 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.489306 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.490766 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.500846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1399/2796] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:25.510109 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1398/2797] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:25 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:25.511215 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.520620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97e33d-c60b-48ed-8318-f10c1eee192f service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.526089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.526683 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.526960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.527230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.527863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.529440 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.540368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1400/2798] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:25.544542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.555434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aaece-8fba-446b-93e2-d03540b2443b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.560116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.560848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.561133 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.561415 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] PATH_INFO: `/v3/projects/52a76218d42f4f36b1a51ecd94d782ca/users/fbb813f9e57f4e5da19710f54c445133/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.578228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a76218d42f4f36b1a51ecd94d782ca, user_id=fbb813f9e57f4e5da19710f54c445133, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.580853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.594123 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1399/2799] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:25 2022] PUT /identity/v3/projects/52a76218d42f4f36b1a51ecd94d782ca/users/fbb813f9e57f4e5da19710f54c445133/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:25.598233 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.608837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75e7e2-12fe-44c9-86e9-87b8911a7c2d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.674702 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.675729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.675729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.676309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.677217 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.679210 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3026a52-2fc1-4104-adac-e4999455700e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.690620 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1401/2800] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:25.695034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.705550 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26dcc-2622-47d5-98a0-427bcff94bd6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.714045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.714710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.714986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.715261 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] PATH_INFO: `/v3/projects/52a76218d42f4f36b1a51ecd94d782ca/users/fbb813f9e57f4e5da19710f54c445133/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.717167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a76218d42f4f36b1a51ecd94d782ca, user_id=fbb813f9e57f4e5da19710f54c445133, role_id=a1bb6f2361b84a8d9412f5dd2cadc1c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.720383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.731759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1400/2801] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:25 2022] PUT /identity/v3/projects/52a76218d42f4f36b1a51ecd94d782ca/users/fbb813f9e57f4e5da19710f54c445133/roles/a1bb6f2361b84a8d9412f5dd2cadc1c9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:25.742471 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.742765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.743044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.771231 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] MFA Rules not processed for user `fbb813f9e57f4e5da19710f54c445133`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:25.772444 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:25.837927 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:25.849500 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1402/2802] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:25.861034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:25.862848 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:25.927450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb5f-01fd-4893-8b75-fe298d1082df admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:25.931210 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:25.931760 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:25.932066 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:25.932342 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:25.942384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:25.943813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010be33b-cab8-4217-aea7-ec6d333a1224 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:25.954940 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1401/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:26.003009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:26.004391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.017828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b119292-b91d-4d7e-82d3-a86076a11192 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:26.021701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:26.022380 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.022708 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.023034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.101488 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:26.103170 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:26.112675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1403/2804] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:26.172420 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.172715 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.172986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.212998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:26.214139 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] MFA Rules not processed for user `115dfecd87314e1ba2d1775eba6c0f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:26.214449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.215362 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.226260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:26.324797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1402/2805] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:26.334253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703007-ad40-4732-bb07-5f608f9fc954 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:26.339598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:26.340343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.340764 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.341121 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] PATH_INFO: `/v3/users/30bda7d284a44e0f8b11e54605bb983c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.341317 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:26.342895 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bda7d284a44e0f8b11e54605bb983c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:26.345328 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:26.357747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb907-fa20-4501-9ab2-db4ac7413b9d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:26.363354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:26.363983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.364264 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.364655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.380580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:26.382537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ddacc-d0fa-440f-b11f-64714be2b85e service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:26.397988 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1403/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:26.422746 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bda7d284a44e0f8b11e54605bb983c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:26.423896 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bda7d284a44e0f8b11e54605bb983c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:26.433194 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bda7d284a44e0f8b11e54605bb983c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:26.450358 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bda7d284a44e0f8b11e54605bb983c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:26.451363 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bda7d284a44e0f8b11e54605bb983c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:26.470092 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1404/2807] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:26 2022] DELETE /identity/v3/users/30bda7d284a44e0f8b11e54605bb983c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:26.475672 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.476220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.476894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.499412 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:26.501619 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.574426 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1404/2808] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:26.587044 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:26.589503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.604342 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:26.656260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2bdb-d5ff-4918-b889-44ea40ba3728 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:26.660325 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:26.661011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.661424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.661765 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.672668 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:26.674144 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:26.684950 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1405/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:26.959864 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:26.961346 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:26.975754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27dbf-cc1c-4356-a494-0c68676b0b55 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:26.980692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:26.981401 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:26.981699 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:26.981990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] PATH_INFO: `/v3/projects/00868525f2e84531809afad3a8b960c2` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:26.983288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00868525f2e84531809afad3a8b960c2)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:26.985795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:27.033537 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00868525f2e84531809afad3a8b960c2', 'request_id': 'req-d818e280-d759-498a-afa9-8d6972de2fc3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.041116 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00868525f2e84531809afad3a8b960c2', 'request_id': 'req-d818e280-d759-498a-afa9-8d6972de2fc3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.048085 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00868525f2e84531809afad3a8b960c2', 'request_id': 'req-d818e280-d759-498a-afa9-8d6972de2fc3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.058399 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] The token cache is being invalidate because project 00868525f2e84531809afad3a8b960c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:27.058688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.059322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.060791 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1405/2810] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:26 2022] DELETE /identity/v3/projects/00868525f2e84531809afad3a8b960c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:27.064733 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:27.074259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bafd9-4b65-48ab-bc1c-7d046a2dfebb service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:27.128404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:27.129011 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:27.129288 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:27.129557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] PATH_INFO: `/v3/users/4fa0b25bb82346bcb1027a67c5f125dd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:27.130664 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa0b25bb82346bcb1027a67c5f125dd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:27.132565 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:27.178334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa0b25bb82346bcb1027a67c5f125dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.179019 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa0b25bb82346bcb1027a67c5f125dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.187009 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa0b25bb82346bcb1027a67c5f125dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.202347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa0b25bb82346bcb1027a67c5f125dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.202934 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa0b25bb82346bcb1027a67c5f125dd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.215334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1406/2811] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:27 2022] DELETE /identity/v3/users/4fa0b25bb82346bcb1027a67c5f125dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:27.487186 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:27.488658 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:27.505018 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e280-d759-498a-afa9-8d6972de2fc3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:27.524256 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:27.564592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:27.565222 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:27.565502 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:27.565781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] PATH_INFO: `/v3/projects/03e910dfb6ff4587930d6823ad234867` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:27.566914 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e910dfb6ff4587930d6823ad234867)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:27.568783 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:27.619360 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e910dfb6ff4587930d6823ad234867', 'request_id': 'req-8d87ebf5-3423-48d5-a26c-f1878a0a8796'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.627855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e910dfb6ff4587930d6823ad234867', 'request_id': 'req-8d87ebf5-3423-48d5-a26c-f1878a0a8796'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.634818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e910dfb6ff4587930d6823ad234867', 'request_id': 'req-8d87ebf5-3423-48d5-a26c-f1878a0a8796'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.647189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] The token cache is being invalidate because project 03e910dfb6ff4587930d6823ad234867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:27.647479 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.648141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8d87ebf5-3423-48d5-a26c-f1878a0a8796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.649929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1406/2812] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:27 2022] DELETE /identity/v3/projects/03e910dfb6ff4587930d6823ad234867 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:27.654119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:27.655689 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:27.669344 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2b2f9-624f-4459-acfc-42d0d61adec5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:27.701143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:27.731729 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:27.732323 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:27.732619 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:27.732869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] PATH_INFO: `/v3/users/348ddb93317546be89292b5ec3194fa5` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:27.734023 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] RBAC: Authorizing `identity:delete_user(user_id=348ddb93317546be89292b5ec3194fa5)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:27.735993 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:27.794237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348ddb93317546be89292b5ec3194fa5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.794952 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348ddb93317546be89292b5ec3194fa5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.803465 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348ddb93317546be89292b5ec3194fa5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.815789 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348ddb93317546be89292b5ec3194fa5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.816490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348ddb93317546be89292b5ec3194fa5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:27.830867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:27.831220 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:27.831560 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:27.832599 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1407/2813] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:27 2022] DELETE /identity/v3/users/348ddb93317546be89292b5ec3194fa5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:27.850866 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] MFA Rules not processed for user `115dfecd87314e1ba2d1775eba6c0f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:27.852069 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:27.925984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1407/2814] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:28.255534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.256998 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.278453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.279576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.338292 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d66e-a7e1-469d-bfe9-2d5031c1326e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.343166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.344039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.344339 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.344808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] PATH_INFO: `/v3/projects/14cde902b8c6400a8db5a75b36b35d80` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.345997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cde902b8c6400a8db5a75b36b35d80)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.348012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.354579 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037434-b89e-4738-9ea7-2ad5793f5cd5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.358385 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.359072 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.359542 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.359819 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.362326 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.374417 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.376605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362da9-1c2a-425d-aca2-7a5bd8f23423 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.383437 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:28.388931 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1408/2815] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:28.402723 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cde902b8c6400a8db5a75b36b35d80', 'request_id': 'req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:28.407035 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:28.412177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cde902b8c6400a8db5a75b36b35d80', 'request_id': 'req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:28.421395 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cde902b8c6400a8db5a75b36b35d80', 'request_id': 'req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:28.434213 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] The token cache is being invalidate because project 14cde902b8c6400a8db5a75b36b35d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:28.434615 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:28.435410 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c4a29519-6bde-4f54-8d08-3fcd5e7ddd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:28.441805 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1408/2816] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:28 2022] DELETE /identity/v3/projects/14cde902b8c6400a8db5a75b36b35d80 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:28.443884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.444391 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.444767 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.467084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:28.468383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.529789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1409/2817] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:28.538808 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.539106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.539389 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.559826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:28.561147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.569821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1409/2818] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:28.574246 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.586492 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964502f-15de-4fa4-8998-0170c03bd71b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.591405 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.592026 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.592308 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.592587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.593239 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:28.593587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.595737 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.608847 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1410/2819] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:28.614109 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.623390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91498e6-f9ae-400f-b282-6b3a00e64490 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.628517 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.629124 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.629400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.629671 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.630368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.632364 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.662207 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1410/2820] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:28 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:28.666788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.677853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e29c9-211a-4c37-a10e-620ad0c02406 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.745711 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.746521 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.746835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.747201 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.747939 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.749986 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.772238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1411/2821] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:28 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:28.776327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.787630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d901e7a-fe4a-4989-be9a-de994f40e386 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.795456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.796072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.796355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.796630 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.797280 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.799503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.810485 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1411/2822] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:28.814536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.824397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5d78c-dd0d-4720-8dfe-50bab8392b38 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.830961 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.831742 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.832028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.832304 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.832950 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.834603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1031802-f88c-4fa7-a24d-89848e8eb3e4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.846473 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1412/2823] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 18:49:28.851116 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:28.861400 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c5f80-dc80-471b-b893-b3b9592c934b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:28.866466 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:28.867114 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.867398 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.867667 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] PATH_INFO: `/v3/projects/a8c2020973ae4cf491118a66e4aa14db/users/5952e4d48c8b44519f9e40d977fd260e/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.883396 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c2020973ae4cf491118a66e4aa14db, user_id=5952e4d48c8b44519f9e40d977fd260e, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:28.886145 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:28.899678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1412/2824] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:28 2022] PUT /identity/v3/projects/a8c2020973ae4cf491118a66e4aa14db/users/5952e4d48c8b44519f9e40d977fd260e/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:28.904852 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:28.905224 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:28.905501 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:28.925331 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:28.926710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:28.990796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1413/2825] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:29.000650 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:29.002369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.070856 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd077-f17f-4741-baaa-07aaa3f0a50c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:29.074531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:29.075146 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:29.075423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:29.075704 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:29.086157 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:29.087680 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698df6a8-c7eb-4340-95ed-2bc24f7a85e7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:29.098259 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1413/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:29.644194 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:29.645576 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.658120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e65daf-d35f-4794-b84e-549f7e8f0bfe None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:29.662621 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:29.663245 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:29.663802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:29.664078 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] PATH_INFO: `/v3/users/cb590a96572d47abbe2cf21f244d8664` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:29.665192 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb590a96572d47abbe2cf21f244d8664)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:29.667147 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:29.668727 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:29.724207 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb590a96572d47abbe2cf21f244d8664'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:29.725434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb590a96572d47abbe2cf21f244d8664'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:29.735650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb590a96572d47abbe2cf21f244d8664'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:29.752938 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:29.753490 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:29.753851 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:29.758569 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb590a96572d47abbe2cf21f244d8664'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:29.759530 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d1ace70a-caf0-445d-8b12-f6d5c8ac1fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb590a96572d47abbe2cf21f244d8664'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:29.775901 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1414/2827] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:29 2022] DELETE /identity/v3/users/cb590a96572d47abbe2cf21f244d8664 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:29.780377 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:29.781435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:29.781926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:29.787452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] MFA Rules not processed for user `5952e4d48c8b44519f9e40d977fd260e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:29.789498 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.811163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:29.812429 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.911590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1415/2828] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:29.939691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1414/2829] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:29.939909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:29.939909 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.948119 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:29.949767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:29.988458 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:30.051714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4fdbb-0bee-4711-86d8-43f519b7c619 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:30.055835 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:30.056716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:30.057161 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:30.057598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:30.057858 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7b508-30d0-4314-978a-f52f81354d04 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:30.062103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:30.062811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:30.064471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:30.064471 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:30.068168 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:30.069818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:30.075655 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:30.077404 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:30.081234 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1415/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:30.090021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1416/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:30.539415 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:30.541138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:30.566039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb012c3-30cf-483c-9ee2-87e5556446b9 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:30.570911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:30.571575 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:30.571990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:30.572276 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] PATH_INFO: `/v3/projects/5ae75bcc42f34e06be9e51a0c7523d0e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:30.573412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae75bcc42f34e06be9e51a0c7523d0e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:30.575424 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:30.629227 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae75bcc42f34e06be9e51a0c7523d0e', 'request_id': 'req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.637595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae75bcc42f34e06be9e51a0c7523d0e', 'request_id': 'req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.644744 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae75bcc42f34e06be9e51a0c7523d0e', 'request_id': 'req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.656520 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] The token cache is being invalidate because project 5ae75bcc42f34e06be9e51a0c7523d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:30.656831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.657595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.659293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1416/2832] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:30 2022] DELETE /identity/v3/projects/5ae75bcc42f34e06be9e51a0c7523d0e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:30.663786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:30.674368 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2938-11bb-4d47-80f6-8178bd6c6ee5 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:30.693193 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:30.733088 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:30.733881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:30.734265 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:30.734544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] PATH_INFO: `/v3/users/fbb813f9e57f4e5da19710f54c445133` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:30.736216 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb813f9e57f4e5da19710f54c445133)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:30.738178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:30.788158 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb813f9e57f4e5da19710f54c445133'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.789062 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb813f9e57f4e5da19710f54c445133'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.795795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb813f9e57f4e5da19710f54c445133'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.811461 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb813f9e57f4e5da19710f54c445133'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.812169 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-84052836-4217-4f62-8874-8e9da89e5035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb813f9e57f4e5da19710f54c445133'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:30.824190 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1417/2833] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:30 2022] DELETE /identity/v3/users/fbb813f9e57f4e5da19710f54c445133 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:31.390531 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:31.393267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:31.418089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab6ab1-fe0c-47b1-943d-d6dc0464e379 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:31.500760 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:31.502080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.502369 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.502697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] PATH_INFO: `/v3/projects/52a76218d42f4f36b1a51ecd94d782ca` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.504237 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a76218d42f4f36b1a51ecd94d782ca)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:31.506960 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:31.525923 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dbb7-d686-4dbc-84f6-44d04822cbf9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.526384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dbb7-d686-4dbc-84f6-44d04822cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.526670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dbb7-d686-4dbc-84f6-44d04822cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.562960 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ed28dbb7-d686-4dbc-84f6-44d04822cbf9 None None] MFA Rules not processed for user `5952e4d48c8b44519f9e40d977fd260e`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:31.564738 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ed28dbb7-d686-4dbc-84f6-44d04822cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:31.569080 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:31.582084 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a76218d42f4f36b1a51ecd94d782ca', 'request_id': 'req-16e5d8c1-aabe-48fa-bd65-93f758241253'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:31.591099 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a76218d42f4f36b1a51ecd94d782ca', 'request_id': 'req-16e5d8c1-aabe-48fa-bd65-93f758241253'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:31.598540 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a76218d42f4f36b1a51ecd94d782ca', 'request_id': 'req-16e5d8c1-aabe-48fa-bd65-93f758241253'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:31.612324 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] The token cache is being invalidate because project 52a76218d42f4f36b1a51ecd94d782ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:31.612501 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:31.613172 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-16e5d8c1-aabe-48fa-bd65-93f758241253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:31.615582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1417/2834] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:31 2022] DELETE /identity/v3/projects/52a76218d42f4f36b1a51ecd94d782ca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:31.620353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.620754 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.621037 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.627869 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1418/2835] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:31.644062 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:31.645279 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:31.708796 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1418/2836] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:31.718300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.718884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.718884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.740821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:31.742798 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:31.752506 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1419/2837] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:31.756719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:31.767301 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc05ba-3a4e-4cc1-ab59-97f1a7ce7f44 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:31.773493 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:31.774143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.774426 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.774697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.775352 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:31.776182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:31.777253 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:31.789467 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1419/2838] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:31.793932 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:31.804375 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5ec4-0de3-4dec-bb7e-6b9346f51371 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:31.809099 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:31.809802 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.810177 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.810523 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.811225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:31.813206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:31.846741 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1420/2839] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:31 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:31.847863 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:31.858638 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6b8c8-e6cb-49f5-aea3-9db404e3278e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:31.930613 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:31.931318 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.931701 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.932076 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.932846 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:31.934947 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:31.961024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1420/2840] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:31 2022] POST /identity/v3/users => generated 281 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:31.966217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:31.976703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d409-0892-451e-800a-4b7a524673d9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:31.981885 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:31.982588 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:31.982941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:31.983286 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:31.984034 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:31.986274 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:31.996773 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1421/2841] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:32.003350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:32.019695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f99f4-ba52-420b-b6c6-bd0d27b594ae admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:32.025138 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:32.025752 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.026156 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.026368 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.027001 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:32.028806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76147a27-affa-4395-8cd1-5dcda017293e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:32.040443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1421/2842] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:32.044867 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:32.055844 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6322f4-7d73-4bd6-b805-1042b052f07a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:32.060968 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:32.061633 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.061920 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.062233 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] PATH_INFO: `/v3/projects/a43a350ade2c40bcbd34b6f7a8ea83a7/users/ce39d2df40e44497b88ee71e096c695b/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.065189 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:32.081364 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43a350ade2c40bcbd34b6f7a8ea83a7, user_id=ce39d2df40e44497b88ee71e096c695b, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:32.084063 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:32.098225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1422/2843] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:32 2022] PUT /identity/v3/projects/a43a350ade2c40bcbd34b6f7a8ea83a7/users/ce39d2df40e44497b88ee71e096c695b/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:49:32.108475 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.108770 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.109048 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.137721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] MFA Rules not processed for user `ce39d2df40e44497b88ee71e096c695b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:32.138962 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:32.168997 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:32.237017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1422/2844] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:32.271386 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:32.273253 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:32.336365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab85811-bdd0-4301-804f-d5088e2ea2c1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:32.340447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:32.341053 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.341335 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.341610 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.350703 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:32.352204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0556ce-2056-4ca1-a6dd-dbf6faa988a8 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:32.362131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1423/2845] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:32.377833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:32.448955 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46f264-d824-4072-84e5-1de33290f198 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:32.458698 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:32.459361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.459649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.460397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] PATH_INFO: `/v3/users/ce39d2df40e44497b88ee71e096c695b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.461623 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce39d2df40e44497b88ee71e096c695b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:32.463941 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:32.522909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce39d2df40e44497b88ee71e096c695b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:32.523646 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce39d2df40e44497b88ee71e096c695b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:32.531510 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce39d2df40e44497b88ee71e096c695b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:32.545917 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce39d2df40e44497b88ee71e096c695b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:32.546791 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce39d2df40e44497b88ee71e096c695b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:32.564573 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1423/2846] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:32 2022] DELETE /identity/v3/users/ce39d2df40e44497b88ee71e096c695b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:32.569503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.569856 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.570283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.591150 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:32.592428 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:32.653038 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1424/2847] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:32.663935 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:32.665437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:32.712327 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:32.725639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e020-7faa-4d0b-809a-05f22aa2c2e8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:32.729271 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:32.729871 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:32.730177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:32.730446 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:32.741889 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:32.743635 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d53a-5a4d-449a-8c24-b48019fd8d46 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:32.753594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1424/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:33.059990 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.062104 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:33.091295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815eec5-acc9-4617-b54d-a837b1cc532e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.096022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.096690 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.097180 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.097515 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] PATH_INFO: `/v3/projects/a43a350ade2c40bcbd34b6f7a8ea83a7` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.098652 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43a350ade2c40bcbd34b6f7a8ea83a7)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.100570 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.151705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43a350ade2c40bcbd34b6f7a8ea83a7', 'request_id': 'req-8ed222ca-6e76-4820-988b-178b2b8ffc0c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:33.160155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43a350ade2c40bcbd34b6f7a8ea83a7', 'request_id': 'req-8ed222ca-6e76-4820-988b-178b2b8ffc0c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:33.167206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43a350ade2c40bcbd34b6f7a8ea83a7', 'request_id': 'req-8ed222ca-6e76-4820-988b-178b2b8ffc0c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:33.179205 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] The token cache is being invalidate because project a43a350ade2c40bcbd34b6f7a8ea83a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:33.179494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:33.180141 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ed222ca-6e76-4820-988b-178b2b8ffc0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:33.181612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1425/2849] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:33 2022] DELETE /identity/v3/projects/a43a350ade2c40bcbd34b6f7a8ea83a7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:33.186390 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.186756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.187101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.209139 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:33.211067 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:33.305355 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1425/2850] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:33.306519 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.306811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.307092 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.334831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:33.336505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:33.346937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1426/2851] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:33.350821 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.364908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dac3c-847e-4337-8ecb-9dbefe7689fc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.370017 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.370639 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.370918 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.371189 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.371861 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:33.372159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.373751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.386884 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1426/2852] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 18:49:33.391121 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.395635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:33.401929 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b11db-1e15-4f5a-83c3-842268662cdc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.409006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.409617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.409899 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.410232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.410882 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.412796 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.446765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1427/2853] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:33 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:33.447833 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.458743 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4db36-409c-4dde-a30e-07bbd8a3762b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.518455 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.519267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.519756 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.522208 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.523002 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.526260 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.550186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1427/2854] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:33 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:33.554242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.565478 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d38c3-de7c-4c87-bc1c-0a91d997451f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.570509 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.571164 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.571453 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.571789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.572383 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.574117 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.584212 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1428/2855] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:33.588193 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.599447 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33292dc-1569-4ea0-bf76-3bfb781969cb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.611050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.611814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.612225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.612643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.613452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.615570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e687-d013-47f0-af3b-783ce1b1a3e9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.630021 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1428/2856] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:33.634354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.645460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ef46-73a1-4c83-a428-b62285d9d4d9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.650520 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.653093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.653093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.653093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] PATH_INFO: `/v3/projects/ff9768e8eed5436f9bb294185ebba7e3/users/0dd7886503d843ffb0904436a7c7a83a/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.669841 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9768e8eed5436f9bb294185ebba7e3, user_id=0dd7886503d843ffb0904436a7c7a83a, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.672763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.701041 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1429/2857] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:33 2022] PUT /identity/v3/projects/ff9768e8eed5436f9bb294185ebba7e3/users/0dd7886503d843ffb0904436a7c7a83a/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:33.702147 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.702437 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.702767 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.764065 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] MFA Rules not processed for user `0dd7886503d843ffb0904436a7c7a83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:33.765312 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:33.833300 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:33.871901 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1429/2858] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:33.883300 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:33.885024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:33.950670 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8d58-3757-4f32-a78e-ede7838b9c29 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:33.955030 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:33.956681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:33.956681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:33.956681 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:33.965972 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:33.967423 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b395da7-3ddc-439a-98b0-a90bf5c03851 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:33.976996 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1430/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:43.868151 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=9 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:43.972938 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:45.607384 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:45.671838 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb77dc6-59b2-43ef-ae92-c7c95467aab0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:45.676819 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:45.677449 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:45.677731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:45.678034 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] PATH_INFO: `/v3/users/0dd7886503d843ffb0904436a7c7a83a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:45.679155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd7886503d843ffb0904436a7c7a83a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:45.681074 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:45.729018 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd7886503d843ffb0904436a7c7a83a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:45.729714 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd7886503d843ffb0904436a7c7a83a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:45.738473 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd7886503d843ffb0904436a7c7a83a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:45.754468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd7886503d843ffb0904436a7c7a83a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:45.755295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b13abb6a-364e-4192-b8dc-91839daed26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd7886503d843ffb0904436a7c7a83a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:45.773142 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:45.773688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:45.773803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:45.775232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1430/2860] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:49:45 2022] DELETE /identity/v3/users/0dd7886503d843ffb0904436a7c7a83a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:45.779448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:45.779740 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:45.780015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:45.793777 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] MFA Rules not processed for user `5952e4d48c8b44519f9e40d977fd260e`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:45.795035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:45.802763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:45.804136 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:45.853409 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1431/2861] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:45.868472 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1431/2862] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:45.874797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:45.876313 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:45.947494 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1634d86-18f7-44ba-be74-5b49f5c017d9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:45.951525 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:45.952260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:45.952604 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:45.952937 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:45.964287 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:45.965705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d238-83d9-491e-8cad-fe84aab468f1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:45.976043 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1432/2863] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:49:46.266529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.269056 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:46.291106 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7d509-86a5-4910-bebc-56a6541c6fd0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.296343 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.296990 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.297277 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.297550 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] PATH_INFO: `/v3/projects/ff9768e8eed5436f9bb294185ebba7e3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.299622 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9768e8eed5436f9bb294185ebba7e3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.301560 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.328155 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:46.370893 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9768e8eed5436f9bb294185ebba7e3', 'request_id': 'req-332975fb-163b-4ae7-93f4-3691c6f278f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:46.379864 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9768e8eed5436f9bb294185ebba7e3', 'request_id': 'req-332975fb-163b-4ae7-93f4-3691c6f278f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:46.386404 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9768e8eed5436f9bb294185ebba7e3', 'request_id': 'req-332975fb-163b-4ae7-93f4-3691c6f278f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:46.398843 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] The token cache is being invalidate because project ff9768e8eed5436f9bb294185ebba7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:49:46.399141 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:46.399942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-332975fb-163b-4ae7-93f4-3691c6f278f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:49:46.401481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1432/2864] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:49:46 2022] DELETE /identity/v3/projects/ff9768e8eed5436f9bb294185ebba7e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:46.407439 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.407759 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.408005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.428270 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:46.429468 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:46.505688 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1433/2865] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:46.514302 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.514511 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.514797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.538412 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:46.540353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:46.552460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1433/2866] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:49:46.556647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.566349 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dcd98-60f0-4908-8adc-8a852c7d3f12 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.571017 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.571617 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.571896 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.572170 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.572818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:49:46.573120 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.574952 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.587776 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1434/2867] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:49:46.592095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.602561 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce201df-412f-4e61-9410-aca861fb7871 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.607468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.608166 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.608529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.608855 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.609542 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.612071 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.641108 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1434/2868] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:49:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:49:46.645675 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.658131 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b30f8-4432-40d9-bec2-5c8f27ce216e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.697571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:46.723834 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.724450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.724733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.725012 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.725651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.727635 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.749770 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1435/2869] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:49:46 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 18:49:46.754657 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.765747 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ef0b9-ef6d-4bc5-bb3d-33d8808f8b84 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.772814 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.773438 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.773715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.774025 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.774675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.776295 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.791267 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1435/2870] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:46.792503 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.804811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c46e-4cce-414e-b120-44063d45d233 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.809606 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.810285 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.810601 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.810880 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.811559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.813145 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526bfb0-3403-4aef-8cd6-5367664798fe admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.824806 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1436/2871] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:49:46.830050 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:46.844768 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6713-619b-418f-bd7c-b7a4418c00ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:46.850182 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:46.851015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.851448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.851985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] PATH_INFO: `/v3/projects/f40aa522fddf4ef38a98ea9abd782b72/users/187a9baabe64463ca5e8291be8ad9f9c/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.875333 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40aa522fddf4ef38a98ea9abd782b72, user_id=187a9baabe64463ca5e8291be8ad9f9c, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:46.879675 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:46.893582 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1436/2872] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:49:46 2022] PUT /identity/v3/projects/f40aa522fddf4ef38a98ea9abd782b72/users/187a9baabe64463ca5e8291be8ad9f9c/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:49:46.908510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4c9a-dd13-4f6d-babe-78bdee570ca9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:46.908803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4c9a-dd13-4f6d-babe-78bdee570ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:46.909084 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4c9a-dd13-4f6d-babe-78bdee570ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:46.946090 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5e3d4c9a-dd13-4f6d-babe-78bdee570ca9 None None] MFA Rules not processed for user `187a9baabe64463ca5e8291be8ad9f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:46.947351 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5e3d4c9a-dd13-4f6d-babe-78bdee570ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:47.021799 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1437/2873] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:47.032499 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:47.034307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:47.098858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05c0a7-33e5-4210-af97-e8e6d29478c4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:47.102869 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:47.103484 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:47.103763 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:47.104038 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:47.113309 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:47.114780 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd826a7-f8d8-4483-a147-86bdecc505ea service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:47.124456 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1437/2874] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:49:48.525341 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:48.525887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:48.525887 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:48.545575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] MFA Rules not processed for user `187a9baabe64463ca5e8291be8ad9f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:48.546812 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:48.553627 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1438/2875] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:49:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:56.840691 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67bc2-a092-4817-8430-47f36a6bf7f1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:56.841230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67bc2-a092-4817-8430-47f36a6bf7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:56.841230 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67bc2-a092-4817-8430-47f36a6bf7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:56.861772 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d9f67bc2-a092-4817-8430-47f36a6bf7f1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:49:56.863102 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d9f67bc2-a092-4817-8430-47f36a6bf7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:56.902881 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:49:56.930543 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1438/2876] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:49:56.944443 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:49:56.945926 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:49:57.022103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92a23-a0fd-42db-be67-3ff4c636c61b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:49:57.027691 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:49:57.028297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:49:57.028603 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:49:57.028876 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:49:57.037547 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:49:57.039155 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:49:57.049455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1439/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 18:50:00.890649 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df24-b9bd-45d2-b65f-08e87aaa6252 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:00.891129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df24-b9bd-45d2-b65f-08e87aaa6252 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:00.891245 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df24-b9bd-45d2-b65f-08e87aaa6252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:00.911096 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-deb5df24-b9bd-45d2-b65f-08e87aaa6252 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:00.912297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-deb5df24-b9bd-45d2-b65f-08e87aaa6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:00.920463 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1439/2878] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:00.934132 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:00.945651 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07308-ebb8-4d25-8dab-29baf8b9491b service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:00.951493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:00.952275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:00.952677 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:00.953028 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:00.963626 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:00.965255 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:00.975462 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1440/2879] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:04.589603 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e2fa-a7bd-4829-ba4d-c8a7e1f001bc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:04.590095 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e2fa-a7bd-4829-ba4d-c8a7e1f001bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:04.590290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e2fa-a7bd-4829-ba4d-c8a7e1f001bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:04.609915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ccc7e2fa-a7bd-4829-ba4d-c8a7e1f001bc None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:04.611169 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ccc7e2fa-a7bd-4829-ba4d-c8a7e1f001bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:04.670112 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1440/2880] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:04.715872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:04.717275 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:04.728628 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:04.787103 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515a9c1-b4f4-49c1-bf44-71877282c8ec service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:04.792327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:04.794195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:04.794195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:04.794195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:04.801747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:04.803369 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ffc77-f253-4450-a906-ec4cbe740a71 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:04.811831 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1441/2881] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:50:05.305858 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:05.306137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786df4e-2e59-4175-8509-794231d3727f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:05.306281 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:05.306432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:05.307532 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786df4e-2e59-4175-8509-794231d3727f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:05.307983 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786df4e-2e59-4175-8509-794231d3727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:05.327915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:05.329468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:05.333237 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9786df4e-2e59-4175-8509-794231d3727f None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:05.334797 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9786df4e-2e59-4175-8509-794231d3727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:05.340529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1441/2882] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:05.348137 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1442/2883] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:50:05.354874 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:05.365853 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786df4e-2e59-4175-8509-794231d3727f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:05.368847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce438aa-69e4-4ae2-aab9-711ef8cc91b1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:05.375859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:05.376696 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:05.377167 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:05.377966 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:05.383384 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786df4e-2e59-4175-8509-794231d3727f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:05.387432 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:05.389222 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b43d0-4e12-4333-9136-a9ecff280e01 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:05.390327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:05.391174 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:05.391698 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:05.392163 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:05.398347 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1442/2884] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:50:05.404325 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:05.406153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:05.418001 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1443/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:06.113081 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f50e1-99fe-42b3-a4ee-e6bd6833cf6e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:06.113612 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f50e1-99fe-42b3-a4ee-e6bd6833cf6e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:06.113718 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f50e1-99fe-42b3-a4ee-e6bd6833cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:06.134911 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6e0f50e1-99fe-42b3-a4ee-e6bd6833cf6e None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:06.136290 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6e0f50e1-99fe-42b3-a4ee-e6bd6833cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:06.144837 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1443/2886] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:50:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:06.199510 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:06.214228 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362d9de-f1d1-4264-b029-92a488a08c60 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:06.220708 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:06.221884 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:06.222411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:06.223025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:06.241366 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:06.245086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:06.263581 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1444/2887] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:50:06.553057 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2313-c351-4a0f-b0ff-2513736f0027 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:06.553351 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2313-c351-4a0f-b0ff-2513736f0027 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:06.553632 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2313-c351-4a0f-b0ff-2513736f0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:06.575594 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-be4a2313-c351-4a0f-b0ff-2513736f0027 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:06.576985 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-be4a2313-c351-4a0f-b0ff-2513736f0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:06.585477 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1444/2888] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 8 18:50:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:06.600024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:06.615238 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ba5a-a56c-4a95-9521-c8e0f7a47fb3 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:06.622665 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:06.623821 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:06.624217 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:06.624650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:06.636114 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:06.637804 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:06.653071 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1445/2889] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:50:07.100806 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce90e4-326e-4ae6-b187-ebf8fe9a378c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:07.101163 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce90e4-326e-4ae6-b187-ebf8fe9a378c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:07.101452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce90e4-326e-4ae6-b187-ebf8fe9a378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:07.129436 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9fce90e4-326e-4ae6-b187-ebf8fe9a378c None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:07.130728 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fce90e4-326e-4ae6-b187-ebf8fe9a378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:07.138101 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1445/2890] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:07.156178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:07.168414 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d71f-05ae-4ed0-85c5-b6cef9df3431 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:07.173784 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:07.174941 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:07.175223 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:07.175493 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:07.185912 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:07.187925 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:07.197605 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1446/2891] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 18:50:08.444282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:08.445579 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:08.446601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:08.477785 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:08.488954 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:08.498942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1446/2892] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:08.520475 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:08.536276 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfa5e-17cb-496c-8eed-9be8b70e2b57 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:08.547559 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:08.548200 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:08.548490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:08.548765 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:08.558013 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:08.559645 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e6911-6d84-4427-8ee4-4309663c4a6d service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:08.569778 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1447/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:09.572987 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:09.586405 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36109-d2ed-4897-85ea-b06887e345f2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:09.592699 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:09.593556 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:09.594049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:09.594678 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] PATH_INFO: `/v3/users/187a9baabe64463ca5e8291be8ad9f9c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:09.596942 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187a9baabe64463ca5e8291be8ad9f9c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:09.599628 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:09.663755 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187a9baabe64463ca5e8291be8ad9f9c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:09.664495 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187a9baabe64463ca5e8291be8ad9f9c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:09.674757 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187a9baabe64463ca5e8291be8ad9f9c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:09.691431 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187a9baabe64463ca5e8291be8ad9f9c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:09.692416 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187a9baabe64463ca5e8291be8ad9f9c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:09.716618 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1447/2894] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:50:09 2022] DELETE /identity/v3/users/187a9baabe64463ca5e8291be8ad9f9c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:50:09.716857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:09.716857 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:09.717395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:09.738309 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:09.739522 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:09.828647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1448/2895] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:50:09.838428 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:09.840367 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:09.854200 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:09.921199 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327c365-f597-45f2-ade0-047eb9760906 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:09.930956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:09.931818 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:09.932434 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:09.932719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:09.948118 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:09.950079 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e9aee-0841-4755-b2ba-ff10253107af service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:09.970697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1448/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:10.164025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:10.165893 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:10.180024 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204efb2-8f75-4373-af7f-b76025f3a315 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:10.185460 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:10.186202 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:10.186710 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:10.187208 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] PATH_INFO: `/v3/projects/f40aa522fddf4ef38a98ea9abd782b72` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:10.188686 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40aa522fddf4ef38a98ea9abd782b72)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:10.191477 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:10.218051 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:10.248458 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40aa522fddf4ef38a98ea9abd782b72', 'request_id': 'req-be47a6dd-1ce8-42ab-8af9-25d7de56207b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:10.257344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40aa522fddf4ef38a98ea9abd782b72', 'request_id': 'req-be47a6dd-1ce8-42ab-8af9-25d7de56207b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:10.265355 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40aa522fddf4ef38a98ea9abd782b72', 'request_id': 'req-be47a6dd-1ce8-42ab-8af9-25d7de56207b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:10.287129 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] The token cache is being invalidate because project f40aa522fddf4ef38a98ea9abd782b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:50:10.287978 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:10.289015 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:10.292321 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1449/2897] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:50:10 2022] DELETE /identity/v3/projects/f40aa522fddf4ef38a98ea9abd782b72 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:50:13.727397 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd6b5-456b-456c-9450-91810f2bee24 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:13.727946 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd6b5-456b-456c-9450-91810f2bee24 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:13.728159 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cd6b5-456b-456c-9450-91810f2bee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:13.753188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fb0cd6b5-456b-456c-9450-91810f2bee24 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:13.756956 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fb0cd6b5-456b-456c-9450-91810f2bee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:13.837633 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1449/2898] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:13.865653 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:13.868075 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:13.976115 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a6dd-1ce8-42ab-8af9-25d7de56207b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:13.982795 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:13.983496 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:13.983692 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:13.983969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:13.994440 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:13.996035 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:14.007021 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1450/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:16.921186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600f71-01d9-4a6f-b95c-dae65558b7f1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:16.921715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600f71-01d9-4a6f-b95c-dae65558b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:16.921715 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600f71-01d9-4a6f-b95c-dae65558b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:16.942513 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-46600f71-01d9-4a6f-b95c-dae65558b7f1 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:16.943716 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46600f71-01d9-4a6f-b95c-dae65558b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:16.952711 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1450/2900] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:16.976948 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:16.990705 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f749d38-e1cb-4355-a9d6-2acfa106541b service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:16.997283 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:16.998766 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:16.999544 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:17.000281 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:17.014813 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:17.016427 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:17.027701 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1451/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:20.355379 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:20.355847 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:20.355948 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:20.377640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] MFA Rules not processed for user `0dade6dd73bb45cc9aaf0e6ac61e5c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:20.379393 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:20.433660 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1451/2902] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 8 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:20.446722 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:20.448079 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:20.516410 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed077-4e1b-472d-80c1-dc5087410b82 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:20.522571 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acb5646ccfe0421591346d235e8f3cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:20.523175 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:20.523455 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:20.523726 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:20.538449 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:20.540106 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:20.550910 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1452/2903] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 8 18:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 18:50:22.469792 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:22.471313 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:22.486075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818f13-6b61-4749-9267-181a3289b3d5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:22.491235 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:22.491857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:22.492134 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:22.492408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] PATH_INFO: `/v3/users/5952e4d48c8b44519f9e40d977fd260e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:22.493529 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5952e4d48c8b44519f9e40d977fd260e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:22.495503 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:22.539651 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:22.543004 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5952e4d48c8b44519f9e40d977fd260e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:22.543731 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5952e4d48c8b44519f9e40d977fd260e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:22.551695 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5952e4d48c8b44519f9e40d977fd260e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:22.563334 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5952e4d48c8b44519f9e40d977fd260e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:22.563964 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70254cf0-f1c7-47b9-ae56-5b9d6bedbc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5952e4d48c8b44519f9e40d977fd260e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:22.575598 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1452/2904] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:50:22 2022] DELETE /identity/v3/users/5952e4d48c8b44519f9e40d977fd260e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:50:23.036269 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:23.047322 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb2cb-a582-4cf6-9928-b14775bc726e service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:23.055260 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:23.109733 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:23.110593 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:23.111365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:23.111365 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] PATH_INFO: `/v3/projects/a8c2020973ae4cf491118a66e4aa14db` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:23.112489 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c2020973ae4cf491118a66e4aa14db)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:23.114589 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:23.163094 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c2020973ae4cf491118a66e4aa14db', 'request_id': 'req-e4061d71-49a9-4b10-9a3b-dadf18daceb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:23.170293 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c2020973ae4cf491118a66e4aa14db', 'request_id': 'req-e4061d71-49a9-4b10-9a3b-dadf18daceb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:23.176397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c2020973ae4cf491118a66e4aa14db', 'request_id': 'req-e4061d71-49a9-4b10-9a3b-dadf18daceb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:23.186498 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] The token cache is being invalidate because project a8c2020973ae4cf491118a66e4aa14db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:50:23.186786 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:23.187411 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e4061d71-49a9-4b10-9a3b-dadf18daceb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:50:23.188877 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1453/2905] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:50:23 2022] DELETE /identity/v3/projects/a8c2020973ae4cf491118a66e4aa14db => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:50:31.201191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:31.201721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:31.201721 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:31.220350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] MFA Rules not processed for user `115dfecd87314e1ba2d1775eba6c0f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:31.221526 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:31.277486 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1453/2906] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:33.183572 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:41.271054 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=4,keystone:SELECT=38,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:44.032650 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:44.033178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:44.033178 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:44.110518 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:44.111754 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:44.208448 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1454/2907] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:44.225908 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:44.227370 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:44.374643 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398d558-0f6f-4200-9834-442a368dccc6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:44.380307 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:44.380909 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:44.381188 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:44.381460 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:44.389408 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:44.391020 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12384033-071d-4660-bb71-2909f3a32cab service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:44.400274 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1454/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:45.881324 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:45.882769 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:45.949984 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:50:45.975580 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236603-3d4d-4686-9e49-135de85e11d3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:45.980946 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:45.981555 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:45.981835 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:45.982138 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:45.983977 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:45.997203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:45.998818 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:46.008894 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1455/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:47.329160 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50fe9f-041d-4ce3-b402-241178185180 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:47.329697 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50fe9f-041d-4ce3-b402-241178185180 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:47.329801 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50fe9f-041d-4ce3-b402-241178185180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:47.349719 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3c50fe9f-041d-4ce3-b402-241178185180 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:47.351317 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c50fe9f-041d-4ce3-b402-241178185180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:47.359049 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1455/2910] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 18:50:47.397575 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:47.409421 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d51db-f0c6-4f70-8415-a85e9679cf50 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:47.415218 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:47.415803 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:47.416083 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:47.416354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:47.424397 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:47.426660 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:47.435781 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1456/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:50.405654 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151f5e-be27-4af7-b582-c70fe698db8d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:50.406183 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151f5e-be27-4af7-b582-c70fe698db8d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:50.406285 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151f5e-be27-4af7-b582-c70fe698db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:50.425403 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ca151f5e-be27-4af7-b582-c70fe698db8d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:50.426674 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca151f5e-be27-4af7-b582-c70fe698db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:50.434481 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1456/2912] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:50.468904 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:50.480148 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68569a8-8bd0-48fd-b61a-1413c01fb607 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:50.485545 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:50.486167 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:50.486466 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:50.486761 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:50.495209 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:50.496763 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:50.506639 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1457/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:53.568439 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912dc6-157d-4ec2-88d4-dfc2e64a7d6d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:53.568915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912dc6-157d-4ec2-88d4-dfc2e64a7d6d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:53.568915 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912dc6-157d-4ec2-88d4-dfc2e64a7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:53.592841 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-14912dc6-157d-4ec2-88d4-dfc2e64a7d6d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:53.594177 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-14912dc6-157d-4ec2-88d4-dfc2e64a7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:53.602353 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1457/2914] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:53.634297 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:53.646295 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f4619-abc8-4362-99f1-87d5ef4851c6 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:53.651667 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:53.652254 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:53.652536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:53.652810 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:53.660714 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:53.662327 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:53.671744 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1458/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:50:56.703745 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ceec5-2055-461b-a244-14b798182602 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:56.704282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ceec5-2055-461b-a244-14b798182602 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:56.704282 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ceec5-2055-461b-a244-14b798182602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:56.723272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-456ceec5-2055-461b-a244-14b798182602 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:50:56.724443 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-456ceec5-2055-461b-a244-14b798182602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:50:56.732075 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1458/2916] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 8 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:50:56.772789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:50:56.783916 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5238d45-292f-47cc-8013-0645c2941437 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:50:56.789378 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4541fb9874e818b90fba97a1fdb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:50:56.789989 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:50:56.790278 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:50:56.790552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:50:56.798736 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:50:56.800294 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:50:56.810086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1459/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:51:06.718132 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=77 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:06.805918 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=34 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:24.600350 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ceec5-2055-461b-a244-14b798182602 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:24.601828 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-456ceec5-2055-461b-a244-14b798182602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:24.615799 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ceec5-2055-461b-a244-14b798182602 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:24.620537 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:24.621165 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:24.621448 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:24.621720 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] PATH_INFO: `/v3/users/115dfecd87314e1ba2d1775eba6c0f16` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:24.622879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=115dfecd87314e1ba2d1775eba6c0f16)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:24.624803 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:24.670232 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115dfecd87314e1ba2d1775eba6c0f16'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:24.670883 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115dfecd87314e1ba2d1775eba6c0f16'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:24.678391 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115dfecd87314e1ba2d1775eba6c0f16'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:24.690186 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115dfecd87314e1ba2d1775eba6c0f16'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:24.690826 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5057ca0e-6da9-4da3-8b4b-48ecccac6d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115dfecd87314e1ba2d1775eba6c0f16'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:24.703492 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1459/2918] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:51:24 2022] DELETE /identity/v3/users/115dfecd87314e1ba2d1775eba6c0f16 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:51:24.875232 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:24.885334 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be64fd-0af9-4798-900e-2d35ed8ec720 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:24.942242 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:24.942872 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:24.943160 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:24.943436 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] PATH_INFO: `/v3/projects/161211850ccd43b1ae43815d532e2c06` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:24.944539 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] RBAC: Authorizing `identity:delete_project(project_id=161211850ccd43b1ae43815d532e2c06)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:24.946457 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:24.992969 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161211850ccd43b1ae43815d532e2c06', 'request_id': 'req-dfd862bc-4ebd-4067-ade3-6ebc638d084f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:25.000195 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161211850ccd43b1ae43815d532e2c06', 'request_id': 'req-dfd862bc-4ebd-4067-ade3-6ebc638d084f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:25.006552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161211850ccd43b1ae43815d532e2c06', 'request_id': 'req-dfd862bc-4ebd-4067-ade3-6ebc638d084f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:25.016682 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] The token cache is being invalidate because project 161211850ccd43b1ae43815d532e2c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:51:25.016967 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:25.017592 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-dfd862bc-4ebd-4067-ade3-6ebc638d084f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:25.019093 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1460/2919] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:51:24 2022] DELETE /identity/v3/projects/161211850ccd43b1ae43815d532e2c06 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:51:25.024452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.024751 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.025015 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.044859 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:51:25.046072 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:25.103322 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1460/2920] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:51:25.111108 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.111395 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.111674 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.132006 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:51:25.133206 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:25.140979 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1461/2921] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:51:25.145024 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.154566 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3f2c5-ea2e-4fe9-b246-9ea3519f77e3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.159383 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.159989 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.160272 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.160549 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.161220 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 18:51:25.161557 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.163191 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.174886 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1461/2922] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 8 18:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 18:51:25.179435 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.188470 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374265-3915-4c85-a7fb-c02cc48e5b7d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.193647 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.194262 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.194541 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.194811 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.195434 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.197314 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.223095 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1462/2923] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 8 18:51:25 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:51:25.227246 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.237293 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4dfec-dc49-468f-8d95-3e0ae90f1d68 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.294258 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.294862 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.295143 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.295417 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.296039 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.297965 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.306298 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:25.321225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1462/2924] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 8 18:51:25 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 18:51:25.325474 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.335612 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3d35-6fe7-42cd-b821-daadf5d406da admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.340149 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.340739 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.341022 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.341299 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.341935 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.343536 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.353204 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1463/2925] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:51:25.357129 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.367831 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2747a-5856-44d1-98bd-8c1716845191 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.372423 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.373012 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.373294 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.373570 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.374243 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.375926 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4236-2209-4b67-a267-214aefc673a1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.387010 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1463/2926] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 8 18:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 18:51:25.390995 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.400789 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6fb6-05b2-4c85-9a9c-838aed46775a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.405358 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.406025 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.406311 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.406587 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] PATH_INFO: `/v3/projects/5bb6a8c17a0442bba04ec5ee66d2cfa1/users/c54652d10cb0466496c0e17e5036a403/roles/ce5d4a8ed4954d7ba651d5f72aa35249` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.421490 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb6a8c17a0442bba04ec5ee66d2cfa1, user_id=c54652d10cb0466496c0e17e5036a403, role_id=ce5d4a8ed4954d7ba651d5f72aa35249)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.424153 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.437855 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1464/2927] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 8 18:51:25 2022] PUT /identity/v3/projects/5bb6a8c17a0442bba04ec5ee66d2cfa1/users/c54652d10cb0466496c0e17e5036a403/roles/ce5d4a8ed4954d7ba651d5f72aa35249 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 18:51:25.448930 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.449218 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.449487 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.477000 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] MFA Rules not processed for user `c54652d10cb0466496c0e17e5036a403`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:51:25.478225 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:25.540378 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1464/2928] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:51:25.551890 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:25.553552 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:25.583100 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:25.631354 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206fcb1-dfa9-4f0c-ae00-d8d7e2f2cf3f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:25.634849 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694edc3a35429b8a2041261f9459e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:25.635450 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:25.635728 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:25.635997 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:25.644037 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:25.645590 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344268a-c248-44f5-8f57-dfca138f65b1 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:25.654374 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1465/2929] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:51:35.537595 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:35.650408 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=23 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:35.843670 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:35.906642 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12faca-a443-418f-ad3b-b8010b6999cb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:35.911669 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:35.912289 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:35.912568 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:35.912836 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] PATH_INFO: `/v3/users/c54652d10cb0466496c0e17e5036a403` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:35.913959 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54652d10cb0466496c0e17e5036a403)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:35.915879 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:35.960885 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54652d10cb0466496c0e17e5036a403'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:35.961534 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54652d10cb0466496c0e17e5036a403'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:35.969706 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54652d10cb0466496c0e17e5036a403'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:35.981857 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54652d10cb0466496c0e17e5036a403'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:35.982533 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54652d10cb0466496c0e17e5036a403'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:35.996031 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1465/2930] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 8 18:51:35 2022] DELETE /identity/v3/users/c54652d10cb0466496c0e17e5036a403 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:51:36.000454 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:36.000747 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:36.001045 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:36.020005 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] MFA Rules not processed for user `31c79467148b4b9fbc6b5124801a4328`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 18:51:36.021203 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:36.079086 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1466/2931] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 8 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 18:51:36.088640 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:36.090090 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:36.166452 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177a511-8a0f-416f-8e46-aac6697458f8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:36.170326 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cef70055b3f49ed9a1aabd221877bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:36.170916 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:36.171192 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:36.171468 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:36.180801 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:36.182244 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:36.191365 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1466/2932] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:51:36.467564 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:51:36.469219 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:51:36.483881 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f17b8-a9e7-4356-9046-73a8b130d677 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:51:36.489230 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31c79467148b4b9fbc6b5124801a4328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '418c9b38e71d4cf1be4f4a5862e811b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:51:36.489911 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:51:36.490225 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:51:36.490505 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] PATH_INFO: `/v3/projects/5bb6a8c17a0442bba04ec5ee66d2cfa1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:51:36.491788 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb6a8c17a0442bba04ec5ee66d2cfa1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:51:36.493663 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:51:36.542956 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb6a8c17a0442bba04ec5ee66d2cfa1', 'request_id': 'req-38bbc14c-3873-448d-baeb-b6ef9822cd0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:36.551447 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb6a8c17a0442bba04ec5ee66d2cfa1', 'request_id': 'req-38bbc14c-3873-448d-baeb-b6ef9822cd0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:36.558340 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb6a8c17a0442bba04ec5ee66d2cfa1', 'request_id': 'req-38bbc14c-3873-448d-baeb-b6ef9822cd0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:36.569548 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] The token cache is being invalidate because project 5bb6a8c17a0442bba04ec5ee66d2cfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 18:51:36.569843 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:36.570623 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-38bbc14c-3873-448d-baeb-b6ef9822cd0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 18:51:36.572288 dv-cinder-856463-3-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1467/2933] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 8 18:51:36 2022] DELETE /identity/v3/projects/5bb6a8c17a0442bba04ec5ee66d2cfa1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 18:51:46.187297 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:51:46.566344 dv-cinder-856463-3-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 18:55:51.699413 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 18:55:51.700797 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:55:51.768305 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48aec8c-82d7-4000-a885-6fabead43898 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 18:55:51.826214 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e477d29670604652952616a8600d11cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b79641d6fe4cdd98ff11762978de2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 18:55:51.826810 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 18:55:51.827089 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 18:55:51.827361 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 18:55:51.829060 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 18:55:51.840046 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 18:55:51.841601 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6d4d1-dc37-4e98-9f15-f42407658399 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 18:55:51.851842 dv-cinder-856463-3-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1467/2934] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 8 18:55:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 18:56:01.847103 dv-cinder-856463-3-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=58 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}